














—s" PSYCHOLOGICAL REVIEW PUBLICATIONS —— 





Psychological Monographs 


EDITED BY 


JAMES ROWLAND ANGELL, Yate Unrversiry. 
HOWARD C. WARREN, Princeton University (Review) 
JOHN B. WATSON, New York (J. of Exp. Psych.) 
SHEPHERD I. FRANZ, Govt. Hosp. ror INSANE (Bulletin) and 
MADISON BENTLEY, Untversirty or ILuinois (/ndex) 








STUDIES FROM THE PSYCHOLOGICAL LABORA- 
TORY OF THE UNIVERSITY OF CHICAGO 





The Conditions of Retention 


BY 
C. W. LUH 


Professor of Psychology, Southeastern University, Nanking, China 


PSYCHOLOGICAL REVIEW COMPANY 
PRINCETON, N. J. 


Acents: G. E. STECHERT & CO.,LoNpDon (2 Star Yard, Carey St., W ) 
Paris ‘lo rue de Condé’ 














‘ 
$ 
‘ 
a 
— a‘ iy Se Bat % » 2: . 
Pea tech: B ycad ,: pre 
me + ae oe ema NO ORE her fa ee A ; ‘ Sie ORC 








Le ei NS Oe ee ree Seen sage aS Je > 2a pie ga ‘ V4 rag 






ACKNOWLEDGMENT 


To Prof. H. A. Carr I wish to express my deepest sense of 
obligation for constant supervision and encouragement. Thanks 
are also due to my friends and fellow-students whose patient 
service made this study possible. Dean J. R. Angell and Dr. J. 
R. Kantor took great interest in my work. To them I owe much 
that cannot be conventionally acknowledged. 











aS ee ee 











IT. 


IIT. 
IV. 


VI. 
VI. 
VIII. 


CONTENTS 


PAGE 
EERE ES OR. a ee kN TE aD I 


The Amount of Retention as a Function of the 
Method of Measurement. ..........cccccece 12 


Retention as a Function of the Degree of Learning. 43 


The Effect of Extending the Time Limit for Recall 


upon the Amount of Material Recalled. ...... 55 
The Relation between the Amount of Error and 

CE Ns rie he o's sek 62 
The Duration and the Speed of Recall. .......... 68 
Individual Differences and Correlations. ......... 73 
Net Pe aa ear yt Oe Pw ey pee 85 





ae ee 


ge 
por olin 0m 


ee ot er ae ee 





os 


ee es mee 
eee ee ae ee yee 


pec TO LS, igre 











> & 


ase op! 





et 
the a 


aie 


CMe at, Bike 





I. INTRODUCTION 


The problem of the present study is to investigate the nature 
of the curve of retention under certain variable conditions. The 
conditions that can be independently varied are numerous. Only 
two series of experiments have been systematically carried out: 

(1) Varying the methods of measuring the amount of reten- 
tion and 

(2) Varying the degree of mastery in the original learning. 

As established by Ebbinghaus,’ the curve of retention for 
nonsense syllables drops very rapidly during the first 20 minutes 
after learning. More than half of the original material is lost at 
the end of the first hour. The subsequent fall of the curve be- 
comes less and less abrupt until about 1 day, when the curve 
runs almost parallel to the abscissa. Similar but far less ex- 
tensive experiments were performed upon himself with meaning- 
ful material, 7. e., poetry. From these results Ebbinghaus de- 
duced the following equation of the curve which has remained 


a classic of forty years’ standing: 


100 k b k 
== » or ——— - 
(log t)* +k 100—b (log t)* 


In this formula b = percentage of retention, 100 — b = per- 
centage of forgetting, t == length of the interval in no. of min., 
and k and c are constants. 

With Miiller and Schumann,’ the technique was greatly im- 
proved in the construction and the presentation of the syllable 
series. Their results corroborated those of Ebbinghaus, though 
the amount of forgetting was less than previously reported. 


b 











1“Ueber das Gedachtniss: Untersuchungen zur experimentellen Psycholo- 
gie,” Leipzig, 1885. Eng. Tr. by Ruger and Bussenius, Teachers’ College, 
Columbia University, 1913. 


2“Experimentelle Beitrage zur Untersuchung des Gedachtnisses,” Zeitschr. 
f. Psychol., Vol. V1, 1803. 
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It was in 1903-04 that Radossawljevitch® attempted a more care- 
ful determination of the curve on a much more extensive scale. 
He employed altogether 29 subjects, as against Ebbinghaus’ one, 
who was himself. Availing himself of the improved technique of 
Miller and Schumann, he further introduced accent and rhythm 
into the act of learning. On the whole, the curve he described 
conforms to the Ebbinghaus type. The amounts of forgetting 
after relatively short intervals were less than either Ebbinghaus 
or Miller and Schumann discovered. 

Finkenbinder,* who re-attacked the problems in 1912, first 
used the anticipation method in presentation. “By that method 
the subject was required to anticipate each syllable by pronou.nc- 
ing it aloud within the exposure period of the syllable preceding. 
Successful anticipation of the whole series constitutes the stan- 
dard of learning. Altogether eleven different intervals were used, 
and these were carefully distributed so as to eliminate diurnal 
variations. He summarized his data as follows: “The curve of 
forgetting for nonsense syllables in series of twelve, as determined 
by the lapse of time, is a uniformly progressive curve much as 
Ebbinghaus found, but under the conditions of our investigation, 
the progress of forgetting is slower than Ebbinghaus found it to 
be, but somewhat faster than Radossawljevitch found.”® Then 
from his numerical data he found this astonishingly simple equa- 
tion: Forgetting = 10 (log. of time in No. of min. + 1), and 
apologized for its simplicity. | 3 

In the above quoted investigations, the method for measuring 
the amount of forgetting was the relearning or “saving” method. 
Forgetting is expressed as a quotient of the amount of time for 
relearning and for the original learning. Strong* first undertook 


3‘Das Behalten und Vergessen bei Kindern und Erwachsenen,” Leipzig, 
1907. 

“The Curve of Forgetting,” Amer. Jour. Psychol., Vol. XXIV, 1913. 

5 Ibid, p. 32. Finkenbinder used series of 12 syllables each; Ebbinghaus, 
13; Radossawljevitch, 8, 12 and 16. Finkenbinder should have compared his 
results with that part of R’s data which were derived from 12-syllable series 
only. 

6“The Effect of Time Interval upon Recognition Memory,” Psych. Rev., 
Vol. XX, 1913, pp. 334 ff . , 
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to extend the investigation with other methods of measuring re- 
sults. The method used in his experiments was the method of 
recognition, or selection, and for material he constructed series 
of common English words of 40 each. Out of each 40, a second 
series of 20 words was drawn at random, which latter served as 
the exposure list. The first list of 40 was given the subject for 
recognition after the lapse of a designated interval of time. 
From these the subject was required to select the exposure list. 
The experiments included 14 intervals and 5 subjects, but only 
I5 measures for each interval. The curve of retention thus de- 
termined was similar in shape to that of Ebbinghaus. The two 
almost agreed as to actual amounts of forgetting until after the 
lapse of the 4-day interval. Strong, therefore, concluded that 
“there is no difference in the form of the curve for retention 
in recall and recognition memory.” By this he did not specify 
whether he implied the logarithmic formula, or only the general 
shape of the curve as to its initial drop and negative accelera- 
tion. 

Bean’ thought that the Ebbinghaus tradition could be sub- 
stantiated on more extensive grounds. In his experiments two 
distinct kinds of material were used, (1) series of 9 conso- 
nants of the English alphabet, and (2) typewriting. In (1) he 
used two methods for the measurement of retention. A. The 
method of written reproduction, in which the subjects were al- 
lowed 2 min. to reproduce the series of consonants which had 
been learned from 1 to 28 days previous to recall. B. The 
method of selection and reconstruction, in which the subjects 
spent 90 secs. in selecting the original series of 9 out of the 
total group of 18 which was being presented, and then took 30 
secs. to put the original 9 in the right order. In (2) typewrit- 
ing, Bean adopted a method similar to that used by Book in his 
pioneering studies in typewriting.*° Bean’s results may be sum- 
marized as follows: 

The curve of forgetting may be studied, (1) as to its general 


“The Curve of Forgetting,” Archives of Psychol., Vol. XX, No. 3. 
8“The Psychology of Skill,” Univ. of Montana Publications in Psychology, 
Vol. I, 1908, Bull. 53, Psy. Series No. 1. 
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form; and (2) as to the absolute rate of forgetting. According 
to him, the curves he presented differ from those of earlier in- 
vestigators and among themselves, not in general form, but only 
in absolute initial amount. Supposing the logarithmic type of 
curve to be general, then an initial high amount of forgetting will 
lead to apparently abrupt transitions. As, to the cause of the 
variations in the absolute or initial amount, numerous conditions 
may be mentioned. 1. Degree of learning. 2. Distribution or 
concentration in the process of learning. 3. Different kinds of 
material. 4. Different methods by which retention is measured. 
5. Individual differences. On the whole, he would conclude that 
all curves of forgetting are logarithmic curves. 

As we shall later develop, the methods he used for measuring 
the amount of retention were mostly crude and inaccurate. He 
did not give any measurement for the statistical validity of his 
data. Further, he himself did not attempt to find equations, or 
rather one general equation, for his own data, and we have to 
take his conclusions only as pious opinions. Finally, in his ex- 
periments, none of the conditions he mentioned was controlled 
and independently varied. | 

An even more sweeping generalization than Bean’s was of- 
fered by Piéron.® He developed a formula which was believed 
to satisfy all the conditions of immediate and permanent memory, 
retention and forgetting, muscular contraction and the phylo- 
genetic development of retentive phenomena, etc. That formula 








k 
is m = — —, where m = percentage of “saving,” t = 
t’ (log t) 
length of the interval, and k, a and c are constants. Then putting 
a == 0, it takes in Ebbinghaus’ curve for human retention, 
k 
m= aan as a congenial member of the “family.’"° But 
og t)° : 


these deductions were based on no surer foundation than a few 
observations upon some pond snails. 


9 “T Fvolution de la Mémoire,” Paris, 1910, pp. 256-60. 

10 Notice how ingenuity is accentuated by forgetting k in Ebbinghaus’ for- 
mula. This is permissible when t is very large. But E’s formula is sig- 
nificant only when it is small. 
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All the above writers seem to concur with the Ebbinghaus 
tradition and to agree on these points. 

(1) Retention decreases with time. 

(2) Forgetting is more rapid at first. 

(3) The curve of retention is generally uniform so that one 
can state it in terms of a mathematical formula. Radossawlje- 
vitch indeed located a sudden deviation at the end of the 8 hr. 
interval, but that was smoothed out in Finkenbinder’s experi- 
ments after the elimination of diurnal variations. 

(4) There is a question as to whether 

A. The curves approximate each other so closely that one 
can regard them as being chance deviations from some ideal 
curve, or 

B. They belong to a single family with one or more variable 
parameters which assume different values according to different 
conditions. Strong inclines toward the former alternative, but 
Bean explicitly favors the latter. 

It is to be noticed that conclusions I to 3 are but descriptive 
summary statements of the facts as observed under their par- 
ticular experimental conditions, while 4 is a mathematical deduc- 
tion. By “the Ebbinghaus type of curve,” one may simply mean 
that facts can be so described and graphically represented, with- 
out implying that they satisfy any kind of an equation. Neg- 
lecting all mathematical complications, may not the phenomena 


of retention and forgetting be, under all conditions, much as 
Ebbinghaus described them? 


In the light of these conclusions, Ballard’s* results become 
significant. He experimented on school children with Latin 
nouns, nonsense poetry, geometric diagrams, nonsense syllables, 
prose, material for logical memory, but above all with ballad 
poetry. For the vast majority of his subjects, the material was 
not completely learned. Written reproduction was required 
after the lapse of a certain interval. He found that the highest 
proficiency of retention, as measured by the amount of repro- 


11“Qbliviscence and Reminiscence,” Brit. Jour. Psych. Monograph Supple- 
ments, Vol. I, 1913, No. 2. 
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duced material, was reached not immediately after learning, but, 
as a rule, at the end of two days. The graphs in Fig. I are illus- 
trative.** Both A and B are curves of retention for children 
about 12 years of age. The amount remembered immediately 
after learning is taken as the basis on which the percentage repro- 


/20 





440 





70 








duced later is calculated. -Graph A. was based upon “The Wreck 
of the Hesperus,” with 20% of the material remembered in the 
“primary test.” B. was based upon “The Ancient Mariner,” 
with 40% of the material remembered. 

These results of Ballard directly contradict every one of the 
conclusions reached by the previous writers. Yet his data seem 
to be at least as valid and reliable as those of our earlier investi- 
gators in forgetting. 


This apparent dilemma suggested to us what was, in a way, 
anticipated by Bean. When the conditions of learning and re- 
calling are changed, not only will the “absolute” amount of for- 
getting change, not only will the mathematical formula change, 
but the phenomenon of negative acceleration may also disap- 
pear. The conditions under which Ballard experimented were 
greatly different from those of other investigators. The follow- 
ing were the most important: : 

(1) The age of the subjects. Ballard’s subjects who mani- 
fested these peculiarities were all children. Compared with his 
own work upon adults, the results indicate that the curve is a 


12 Jbid, p. 5. 
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function of the age of the subjects. Other investigators worked 
mostly with adults. 

(2) The kind of material. Ballard used but little nonsense 
material and did not work on a separate curve of retention for 
nonsense syllables. The Ebbinghaus type of curve is a curve for 
nonsense syllables par excellence. Ebbinghaus’ and Radossawl- 
jevitch’s experiments with meaningful material were only supple- 
mentary to their principle problem and were haphazardly per- 
formed. 

(3) The degree of learning. In Ballard’s experiments, the 
material was only partly learned. The degree of learning for the 
curves quoted above was 20% and 40%. The subjects had to 
stop at a given time limit. In all previous work, except that of 
Strong, the material was learned at least to the first errorless 
recitation. 

(4) The method of measuring the amount of retention. Be- 
fore Ballard, the method that was generally used was the “sav- 
ing’ method. Bean and Strong tried the “selection” method, but 
not very extensively. Ballard, however, found the written repro- 
duction method to be more suitable for group experiments. 

This comparison suggests the question as to whether the curve 
of forgetting, or of retention, is a function of these conditions, or 
more specifically, whether each condition determines a special 
curve. The present study is an attempt to answer this question. 
This can be carried out only by varying the above mentioned 
conditions independently and systematically. Unfortunately, 
Ballard’s technique has netessitated a program which demands 
more time than we can at present afford. We have, therefore, 
limited the scope of the problem by taking up only the third 
and fourth factors, leaving the first two to a later investigation. 


GENERAL DESCRIPTION OF THE EXPERIMENTS 


The experiments were performed in the Psychological Labora- 
tory of the University of Chicago, the first series from May to 
August, 1919, and the second from October, 1919, to February, 
1920. 
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(1) Material 

Series of nonsense syllables of 12 each were used. With 
the English alphabet, a list was made of all possible combina- 
tions of two consonants joined by a vowel in the middle, except 
those which end in y. From this list we eliminated all the Eng- 
lish, French, German and Latin words. The revised collection 
was then submitted separately to four graduate students of the 
department who checked every syllable which happened to call 
up immediate meaning associations. All syllables thus marked 
out by more than one of the observers were further eliminated 
from the final list. 

In the construction of the series, Miiller’s** rules were observed 
as closely as possible. That is, 

(1) All the initial and final consonants of the same series are 
different. 

(2) Since we did not resort to the use of diphthongs, we had 
five vowels as against Miiller’s twelve. The terms were arranged 
so that no two of four consecutive syllables have the same 
vowel. | 


(3) No two consecutive syllables have any consonant in com- 
mon. 


(4) No group of consecutive syllables constitutes a polysyl- 
labic word or a phrase, 

Thus we have improved upon Miller in at least two respects. 
(1) He overlooked monosyllabic words, which, perhaps, is not 
sO serious an omission in German as in English. (2) While he 
allowed a syllable to end with the initial consonant of the pre- 
ceding syllable, we excluded all such cases. 

Since in our investigation we required the subject to spell each 
syllable letter by letter, instead of pronouncing it as a whole, we 
are no longer concerned with Gamble’s rules** which were for- 
mulated as safeguards against the inherent defects of English 
orthography. We also think that spelling the syllable letter by 
letter tends to minimize its meaning associations. 


18 Op. cit., p. 106. 


14“A Study in Memorising by the Reconstruction Method,” Psych. Rev., 
Monograph Supplements, Vol. X, No. 4, p. 22. 
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Altogether about 90 series were constructed so that a subject 


could serve extensively without resorting to learning a single 
syllable twice. 


(2) Apparatus 

The apparatus was an ordinary rotating drum used in the 
Chicago laboratory for most of the memory experiments. After 
the series were typewritten on strips of white manila card, they 
could be easily fixed to the drum. One syllable was exposed at 
a time through an aperture in the screen attached to the posts 
of the drum. It was found more convenient to run the apparatus 
by hand than by a mechanical device, since the experimenter had 
to keep his eyes on the aperture in order to be perfectly sure 
that the subject spelled the syllable completely before the suc- 
ceeding one was exposed. 

In experiments like these, every moderately loud noise may 
be disturbing. For this reason the experimenter had to keep the 
time by running a telephone wire from an adjacent room in which 
a metronome was set at two seconds. : 

In the later part of the first series of experiments and through- 
out the second, it was thought worth while for purposes other 
than that of the present study to keep minute records of every 
correct or incorrect response. A Remington typewriter No. 6, 
invisible, served as the apparatus, so that the subject would not be 
distracted by what was being recorded. Two keys were arbi- 
trarily chosen to mark success and failure. The striking of the 
key made a noise every two seconds. The effect of this appar- 
ently disturbing factor was inappreciable, so far as we can de- 
termine from the practice curves of the individuals. 


(3) Method of Presentation 


The subject was seated at a convenient distance in front of the 
rotating drum. Before the presentation of every new series, the 
experimenter gave the signal “ready,” one second after which 
the first syllable was exposed. This signal became superfluous 
after one or two weeks of practice. The time of exposure for 
each syllable was 2 secs. No restriction was made as to the 
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method of learning, excepting that the subject was warned, not 
to form artificial meaning associations. Beginning with the 
second exposure of the series, he was instructed to attempt to 
anticipate each syllable by spelling it aloud before it was exposed. 
Usually 6 seconds were allowed between successive presenta- 
tions of a series, during which the experimenter shifted the drum 
and made the necessary records. A series was considered learned 
once the subject successfully anticipated every syllable. All 
series were learned by successive presentations in a single sitting. 

Each subject was required to return at the same time of the 
day, but could skip two or three days in succession between 
series. Only one series was learned in a day. Occasionally 
the learning of a new series followed immediately after the recall 
of the preceding one. But this never happened in the second 
series of experiments. 

The different intervals and the methods of measurement, as 
will be described later, were distributed according to a tentative 
scheme drawn for each subject. Sometimes that schedule had 
to be slightly changed, but care was always taken to reduce to a 
minimum the effect of uncontrolled practice. 

Each subject was given 4-6 series for preliminary practice. 
These results were not counted. (Subject C, who learned only 
20 series, began to work late in the summer. Only 2 practice 
series were possible with this subject. His results could have been 
improved by giving 2 or more additional preliminary series). 


(4) Subjects 


Ten subjects a day were all we could handle. We had two 
groups of ten each. The first group included one instructor and 
three graduate students of the department and six Chinese stu- 
dents of the University who had one time or another taken some 
work in psychology. In the second group, there were six gradu- 
ate students and one senior of the department, including the ex- 
perimenter. The other three were Chinese students of the Uni- 
versity, two of whom never had any work in psychology. Sub- 
ject ‘’. a Chinese student who learned 20 series in the summer, 
served again as one of the ten. When the experimenter served 
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as subject, the series were given by Mr. T. L. Wang, who had 
also served in previous experiments. In this case, the series were 
made according to rules unknown to the experimenter. They 
were very similar to the ordinary ones. 

Apparently the Chinese students had no serious difficulty in 
learning this type of material. They were able to memorize 
directly without translating the exposed material into Chinese 
equivalents. On the whole, they learned the series very much 
faster than did the Americans. 
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II. THE AMOUNT OF RETENTION AS A FUNCTION 
OF THE METHOD OF MEASUREMENT 


In the first series of experiments, two methods of recall were 
used, which together furnished five measurements of the amount 
of retention. 

1. The Anticipation and Relearning Methods. In one half of 
the series given to each subject, the method of presentation in 
relearning was identical with that of the original learning. 

(A) Thus, the subject was required to anticipate the series 
at the very first presentation, at the rate of 2 sec. for each syl- 
lable. The number of correct syllables was recorded. That 
number, expressed as a percentage of the whole series, established 
a measurement of retention in terms of anticipatory recall. 

(B) After the first record was taken, the series was exposed 
as many times as necessary for complete relearning. A measure- 
ment of retention was thus furnished by the “Saving Method.” 

2. The Reproduction, Recognition and _ Reconstruction 
Methods. These methods were used with the other half of the 
series given to each subject. 

(C) The subject was first furnished with a recall blank, on 
which were three columns of figures from I to 12, each with a 
blank space to the right. He was instructed to write down the 
original series in the right spatial order, beginning with the left 
hand column, but not necessarily in the same temporal order as 
the series was learned. At the end of 1 min. the experimenter 
gave a signal, at which the subject began to write in the middle 
column, filling out spaces that had been left open during the first 
minute, or correcting any mistake that he thought had been 
made. Another signal was given at the end of the second 
minute. At this, the subject changed to the right hand column. 
Three more minutes were allowed for further reproduction and 
correction. The subject could, of course, “give up” at any time, 
or finish the whole series before the lapse of the first or second 


12 
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minute. A time record was also taken for each series completed 
within the above 5 min. This constituted a measurement of re- 
tention by the Written Reproduction method. | 

(D) Immediately following upon written reproduction, a 
group of 24 syllables was given the subject, out of which he was 
required to select the original 12, no more and no less. At the 
end of go sec. the experimenter quietly took a record of the 
number of correct and incorrect syllables selected up to that 
time: A similar record was taken when the subject completed 
the selection of 12 syllables, correctly or incorrectly, together 
with a time record. The time limit, 90 sec., was determined from 
the averages of the preliminary records of all the subjects in the 
first series of experiments. This process gave a measurement 
of retention in terms of Recognition. 

(E) Finally, the subject was furnished with the original 12 
syllables on separate slips of white manila card and was required 
to reconstruct the order of the series. The actual order of recon- 
struction was recorded, and also the amount of time spent in the 


reconstruction process: This we may call the Reconstruction or 
Rearrangement method of recall. 


INTERVALS OF TIME 


Five intervals of time, ¢. e., 20 min., I hr., 4 hrs., 1 day, and 2 
days, were selected with two considerations in view. 

(1) To facilitate comparison with earlier reports, it was nec- 
essary to fix our program into that of other investigators. Ac- 
cordingly, intervals which had not been included in the work of 
one or more of our predecessors do not appear in our plan. We 
further took into consideration whether the points on the curve 
to be thus empirically determined would be likely to represent 
an equation, if there be one. Cf. Table VII. 

(2) We also tried to avoid the effect of diurnal variations. 
Later we found that the 4 hr. interval was too long for our pur- 


pose. Any interval longer than 4 hrs. and shorter than 24 would 
be too much beyond our control. 
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METHODS OF SCORING 


(1) Anticipation. With this method complete retention is 
the successful anticipation of every syllable. There are 12 syl- 
lables in each series. On the basis of 12 one can easily convert 
an actual score into percentage terms. 

(2) Relearning. The usual “saving method” was used, in 
which the number of presentations in relearning minus one, di- 
vided by the number of presentations in learning minus one, mul- 
tiplied by 100, gives the percentage of forgetting. 

(3) Written Reproduction. First, the reproduced amount is 
compared with the possible amount. X correct syllables repro- 
duced is scored at X/12, which, multiplied by 100, gives a per- 
centage score. A syllable with only 2 letters correct is scored 
14, as is also one with the initial and final consonants inverted. 

Secondly, we took into consideration the position and sequence 
of each reproduced syllable. The difficulties for such minute 
scoring are two. (1) The relative value of the reproduced 
amount on the one hand and of position and sequence on the 
other can only be arbitrarily determined. (2) By chance the 
subject may reproduce a certain number of syllables in the 
original position or sequence without actually remembering 
either, and it is well nigh impossible to score this chance factor. 
In the present study, the total amount of reproduced material 
will be roughly scored %, and position and sequence % each. 
It is assumed that material contributes as much value as position 
and sequence put together, and the latter are again considered 
to be equal in value. The chance factor is neglected. The records 
are, therefore, scored too high, but the extent of this effect one 
can easily approximate when we come to deal with the method 
of scoring reconstruction. Any such arbitrary process will, of 
course incur all the criticism that has been heaped upon Lyon* 
by writers like Kjerstad.? The latter, however, also neglected 
the chance factor. Our interpretations will be based mainly upon 

i1“A Rapid and Accurate Method for Scoring Nonsense Syllables and 
Words,” Amer. Jour. Psychol., Vol. XXIV, 1913, pp. 525-31. 


2“The Form of the Learning Curves for Memory,” Psych. Rev., Monograph 
Supplements, Vol. XXVI, 1919, No. 5, pp. 14 ff. 
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the first method of scoring, which does not take into account po- 
sition and sequence. 

Further, unlike the other methods of scoring, the values for 
written reproduction are independent of the amount of error 
made in recalling. The amount of error may also be reduced to 
percentage scores when compared with the actual or the possible 
amount of retention, ¢. e., the amount of error may be computed 
as a percentage either of the whole series or of the reproduced 
material only. 

(4) Recognition. When a number of syllables originally 
learned are mixed up with an equal number of new ones and then 
presented to the subject for recognition, the outstanding fact is 
that, by pure chance, one will most probably draw half of the 
original ones. Bean* overlooked this difficulty. Consequently, 
all his values were above 50% even to the end of the 28th day. 


To eliminate this chance factor, Strong* devised the formula, 


Correct recognitions Correct — incorrect recognitions 
Retention = x X 100. 


Total no. presented Correct + incorrect recognitions 
No doubt, this formula takes into account the extremes of proba- 


bility. That is, out of X things learned, a recognition of X/2 is 
scored 0, while a recognition of X is scored 100. Beyond that, 
the formula is exposed to numerous difficulties and seems to de- 
feat its own purpose. The author pointed out that “it penalizes 
mistakes a little more than is warranted on a basis of chance.” 
As a matter of fact, it penalizes sometimes too much and some- 
times too little. In other words, the scores given on this basis 
are not always proportional to the probability. That propor- 
tionality, it seems to me, ought to be the criterion for the validity 
8—I 
8+1 
Similarly, 8 correct ones and 2 incorrect ones would be scored 
20.0%, and 8 correct ones and 3 incorrect ones 15.6%. Now 











of the formula. For instance, = x X 100 = 25.9%. 


8 Op. cit. His reproduction method is not any better. When one is re- 
quired to write down 9 out of 18 consonants it is most probable that 4 or 5 
will be correct, even though one does not realize there are only 18 consonants 
in the English alphabet. 

4 Op. cit. p. 355. Cf. Psych. Rev., Vol. XIX, pp. 457 ff. 
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_ when 24 members are presented, the respective probabilities for 


945 3465 9075 


these three combinations to occur are ; : , 
52003 52003 52003 


provided that, by pure chance, one is as likely to take 9 as I0 or 
11. It is very difficult to see how the chance factor is counter- 
balanced by giving scores such as the above.. 

Again, suppose that of the total group presented, the subject 
selects only 1 and that 1 be correct. According to the formula, 


I I—oO 
this performance would be scored x —— X 100. 
Total no. I1+o 








But if in the total number presented, the number of original ones 
is equal to the number of new ones, the subject will be just as 
likely to draw a correct one as an incorrect one. Such a per- 
formance should be scored o. 

Other defects of the formula, while not inherent and unavoid- 
able, result from assumptions which one makes in applying it. 
Thus Strong required his subjects to classify their judgments 
according to degrees of certainty. After the first class, 7. ¢., 
the most certain one, is scored by his formula, the second and 
third classes cannot be penalized as rigidly, since chance has 
been greatly reduced by the exclusion of the correct ones in the 
first class. | 

Further, on the basis of the first class as 1, Strong scored the 
second class 34, and the third class 1%. These values are en- 
tirely arbitrary and have nothing to do with the formula. But 
this method of scoring, together with the last named oversight, 
certainly helped to make his curve of recognition memory some- 
thing like Ebbinghaus’ curve. 

In the formulation of our own method of scoring, we first 
take it for granted that, if there were no chance factor, each 
score should then increase upon the next by a constant amount. 

Then we calculated the probability of each kind of combination. 
Thus, when the total group of 24 is presented, there are 2704156 
possible ways to take 12. These are classified as follows: 
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No. in which there are 12 correct and o incorrect, I 
II I 144 
10 2 4356 
9 3 48400 
8 4 245025 
7 5 627264 | 
6 6 853776 

etc. 


Six correct is the highest probability, the combination which is 
most likely to occur on the basis of pure chance. If we next 
regard this probability as 100% chance, we have 


6 correct and 6 incorrect, 100.00% chance, 


7 5 73-47 To 
8 4 28.70% 
9 3 5.67% 
10 2 51% 
II I 027 
12 0 00% 


Everything below 6 correct may be disregarded. Now divide 
100 into 6 equal intervals, from 6 to 12, for scores when the 
chance factor is not deducted. Deducting from each interval the 
relative amount of chance, the final scale is 








TABLE I 
CORRECT INCORRECT PRELIMINARY SCORE CHANCE FINAL SCORE 
6 6 0.00 100.00 onh..° >. 
7 5 16.67 73-47 4.42 
8 4 33-33 28.70 23.76 
9 3 50.00 5.67 47.17 
10 2 66.67 51 66.33 
II I 83.33 02 83.31 
12 0 100.00 .00 100.00 


By extending this method, we can score recognition (1) for 
any number of things presented, (2) for any number selected 
(not necessarily one-half of the number presented), and (3) for 
any number of correct or mcorrect things selected. This may be 
seen from Table II, which can be extended indefinitely. In scor- 
ing, we can make use of this table and save a tremendous amount 
of time. 

One must remember that these values are the most probable 
values. That is, in the long run, they will measure actual ef- 
ficiency. Another method, and a more logical one, to score proba- 
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bility is to take, for instance, a performance of X correct choices 
and 12 — X incorrect ones, and see how probably that perform- 
ance would happen, supposing the subject actually knows only 
I, 2 or any number of the correct things selected. Score the 
number that the subject is supposed to know in order to make 
such a performance most probable. 

However, this method does not serve our purpose, because 
it sometimes gives ambiguous results. For example, if a per- 
formance is 9 correct to 3 incorrect, we do not know whether 
the subject should be credited with 8 or 9 which he is supposed 
to remember. For 


Supposing he knows 9, then the Supposing he knows 8, then the 


probability for him to get probability for him to get 
 Oeeweet is... 60. s Sakeed 220/455 fe. eye rrr re 495/1820 
RY ep EG Secker eg e 198/455 oe ake eeneen . 880/1820 
Maro. keeseetns eae 36/455 i os Seas baey . +++ +396/1820 
Sie M yada vue eee 1/455 mest Pils bes Ou babe 48/1820 
RO: a cc idendeaee 1/1820 


But the highest probability of the first column is equal to that 


of the second column. . 
220 880 
455 1820 
Shall the subject be credited'8 or 9? 


TABLE II 
Table for Scoring Recognition Memory, 24 presented, 








12 correct + 12 incorrect 


Zz 
° 


NO. SELECTED 
CORRECT I 2 3 4 5 6 7 8 ee) eee eee 
00.00 00.00 00.00 00.00 00.00 00.00 00.00 00.00 00.00 00.00 00.00 00.00 
09.03 00.00 00.00 00.00 00.00 00.00 00.00 00.00 00.00 00.00 00.00 
18.06 06.57 00.00 00.00 00.00 00.00 00.00 00.00 00.00 00.00 
29.54 12.31 05.42 00.00 00.00 00.00 00.00 00.00 00.00 
39.40 26.78 10.11 04.82 00.00 00.00 00.00 00.00 
49.05 34.93 25.03 09.03 04.52 00.00 00.00 
57.82 48.06 32.40 24.07 08.51 04.42 
66.52 55.39 47.40 31.21 23.76 
74.96 66.39 53.91 47.17 
83.32 73.25 66.33 
91.67 83.31 
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(5) Reconstruction. In this method, we encountered the same 
difficulty of chance success, and so far as we know, no attempt 
was made to eliminate this factor in previous studies. We first 
divide our problem into (A) position and (B) sequence. It is 
evident that, by chance, one may put a part of the series in the 
original position and sequence. 

(A) Take position first. Assuming perfect chance in the re- 
arrangement of n things, the number of ways for X of the n 
things to be out of the original order is the number of n things 
taken X at a time, minus the number of permutations of X 
things in which the X things are not all out of the original posi- 
tions. For 12 things, the probability for any number of them to 
be out of position as compared with any other number, is 

O positions out, I 
2 66 
440 
4455 


34848 
244860 
1468368 
7342335 
29369120 
88107426 
176214840 
176214841 
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479001600 
Taking 17621841 as 100% chance and following the same pro- 


cedure as in the recognition method, we have the results as given 
in Table ITI. 





TABLE III 
POSITIONS OUT #§ PRELIMINARY SCORE CHANCE FINAL SCORE 
12 00.00 100.00 00.00 
II 09.09 100.00 00.00 
10 18.18 50.00 09.09 
9 27.27 16.67 22.72 
8 36.36 4.17 34.84 
7 45-45 83 45.07 
6 54.55 14 54-47 
5 63.64 02 63.63 
4 72.73 00 72.73 
3 81.82 .0O 81.82 
2 90.91 .00 90.91 
rs) 100.00 .00 100.00 
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The principle applied in the development of this scale is not 
limited to a series of any particular number. 

(B) Sequence. Here we failed to formulate a simple mathe- 
matical statement of the relative amounts of chance and had to 
depend upon empirical data. By casting a series of 12 members 
1000 times and recording the chance sequences of the members, 
we obtained the results given in Table IV, 


TABLE IV 
MEMBERS OUT OF ORIGINAL SEQUENCE 





I 2 3 4 5 6 7 0. oe 08 

Ist 100 trials oO oO .. = . - I :. ts 2 2 

2nd 0 oO oe: °¢@ o I oO i Se. . a ee 

3d 0 OC rng rrp oe 5 10 35 48 100 
4th oO oO oO Qie® oO I 4 19 34 42 #4100 
5th O oO oO re) re) oO 8) 4 14 45 37 + «2100 
6th O Oo 806060 o.)6|0OUO oO I 5; @ 2 2. = 
7th re) oO oO oO oO oO I a. € 2 a ae 

8th oO oO o 0 I oO oO 4-82 9: @- ms 

oth O oO Ss oO I I s 8S ae oe 

roth O o Oo ox oO I 3. 2 ee ae 
0 . oe I 2 8 40 152 372 425 1000 


Comparing the totals with each of the Io groups, we concluded 
that these results were regular enough to be a valid sample. We 
then followed exactly the same procedure as in the scoring of 
position and obtained the final scale as given in Table V. 


TABLE V 
© out of sequence, Score 100.00 
90.91 
81.82 
72.73 
63.64 
54.42 
45.24 
35.68 


24.70 
11.68 


1.13 
II .0O 
(C) After scoring both position and sequence, the average of 
the two was taken as a rough measurement of Reconstruction 
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memory. This final process is arbitrary and may be entirely 
superfluous. It does not furnish any more adequate measure- 
ment of reconstruction than position and sequence taken sepa- 
rately, since the resulting values do not lend themselves to a 
clearer interpretation. 


QUANTITATIVE DATA 


The results from these five methods of measurement are 
tabulated in Table VI and graphically represented in Fig. II. 


TABLE VI 
PERCENTAGE OF RETENTION 
20 min. 1 hr. 4hrs. I day 2 days 
AED 5 os ie enccksnidls 67.8 50.2 39.0 17.8 10.0 
RE no cctnavensinens 75.0 65.9 54-9 52.1 47.7 
Written reproduction........ 88.1 82.1 60.5 39.2 26.7 
Mecometrwction . ow vei setesce Q1.5 89.7 75.4 50.9 38.6 
IE «o's na wa wa tdeuwes 97.8 94.6 93.3 74.6 71.5 


From Table VI and Fig. II, the phenomena of retention may 
be generally stated as follows: 

(1) The amount of retention decreases with time. 

(2) On the whole, forgetting is most rapid at first, but there 
are two notable exceptions. A. The curve for recognition slopes 
down much more rapidly from 4 hrs. to 1 day than from 1 to 
4 hrs. B. In reconstruction, the decrease in the amount of. re- 


tention is more rapid from.1 hr. to 4 hrs. than from 20 min. to 
I hr. 


(3) All the curves are relatively uniform and can be described 
by mathematical formulae. 


*In the latter part of this series of experiments, it was found necessary 
to counteract the effect of diurnal variations by distributing the 4-hr. series 
more carefully. Some of these series were given at the regular learning 
time of the day for each subject; the rest were given either 4 hrs. before or 
after that time. This procedure was carried out only for anticipation and 
relearning. Subject K’s records were excluded from the above averages 
for not being so distributed. 

Because of a mistake in scoring, subject D’s 5 records had to be excluded 
from the averages for anticipation. 

Altogether, the averages for anticipation represent 28 records from 8 
subjects; relearning represents 33 records from 9 subjects; the rest include 
35 records from 10 subjects. 
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(4) Four of the curves stand invariably in a given order. 
Recognition gives the highest values. Reconstruction occupies 
the second position. Written reproduction follows as a close 
third. Anticipation always has the lowest value. 

(5) The relation of the values for relearning varies with the 
time interval. As may be seen, its order is fourth for the 20- 
min. interval and second for the 2-day interval. 

In general, these conclusions are in harmony with the results 
of earlier investigations, except those of Ballard. These results 
are brought together in Table VII and compared with those of 
the present study. 

In relearning, the present results approach most closely to 
those of Finkenbinder. In no instance is the difference more 
than 10%. Finkenbinder used practically the same technique 
as our own, excepting that we required the subject to spell the 
syllable instead of pronouncing it as a whole. 

With the “saving method,” an increase in the number of pres- 
entations in learning increases the amount of retention, while 
an increase in the number of presentations in relearning de- 
creases the same. Since the number of presentations in relearn- 
ing is almost always smaller than that of learning (except in cases 
of 100% forgetting), every increase of equal or nearly equal 
magnitude in the number of presentations in both learning and 
relearning will increase the amount of forgetting, or, in other 
words, it decreases the amount of retention thus calculated. 


THE CONDITIONS OF RETENTION 23 





TABLE VII 
Relearning Recognition 
INTERVALS EBBING. RADOSSAWLJEVITCH FINK. LUH STRONG LUH 

15 sec. * 84.6 

5 min. 97-5 95-9 72.7 

15 min, 62.7 97.8 
20 min. 58.2 88.6 89.8 75.0 

30 min. 75.0 55-5 94.6 
1 hr. 44.2 70.7 75.3 72.8 65.9 57:3 94.6 
2 hrs. 60.4 472 93-3 
4 hrs. 64.4 54-9 50.6 93.3 
8 hrs. 35.8 47.4 66.5 65.5 40.6 

12 hrs. 63.8 41.1 

16 hrs. 63.0 
24 hrs. 33.7 68.9 70.2 57.8 52.1 28.8 74.6 
36 hrs. 588 

2 days 27.8 60.9 72.3 55.6 47.7 22.9 71.5 
3 days 52.1 

4 days 19.3 

6 days 25-4 493 50.5 

7 days 9.6 

14 days 41.0 51.4 

21 days 378 48.6 

30 days 21.1 20.2 27.0 

42 days 6.3 

120 days 28 3.3 





* Averages reconstructed from R’s principal experiments which included 
only series of 12 syllables. The column immediately to the left, as quoted by 
F., represents averages from 8, 12 and 16 syllable series. 


Other things being equal, it takes a subject more presentations 
to spell a series correctly than to pronounce it correctly, both in 
learning and relearning. This may explain the fact that the 
relearning values reported in the present study are lower than 
those of Finkenbinder. 

Similarity of technique does result in proportional similarity 
of quantitative data. It points toward the possibility of estab- 
lishing norms, though not one norm or one general curve of 
forgetting, for various conditions of retention. Other numerical 
differences between the present study and previous reports may 
be easily accounted for by individual differences and the disparity 
of methods. 

The difference between our recognition values and Strong’s is 
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sometimes as high as 50%. There is no cause for wonder, how- 
ever, since the data were collected under as divergent conditions 
as imaginable. The material, the degree of learning and the 
methods of scoring were all different. Our data will have to be 
distorted a great deal before they can conform to the Ebbing- 
haus type of curve. Even if we could derive a general equation 
which satisfies both sets of values, it would be so complex and 
obscure that scientific interpretation would be better off without 
it. Here lies the danger of speculation without specifying the 


conditions and variables which enter into the determination of 
our values. 


MISCELLANEOUS COMPARISONS 


1. The Difference between Scoring the Number of Syllables 
and of Letters in Anticipation. 

There are altogether 12 syllables, or 36 letters, in each syllable 
series. Since a syllable may be only partly anticipated, 1. e., 
when only one or two letters of the syllables are anticipated in 
the correct position and sequence, it is evident that scoring the 
number of letters will give higher values than scoring the num- 


ber of syllables. The increment is, however, very small, as can be 
seen from Table VIII. 


TABLE VIII 4 


29.min. hr. QO hrs. Iday 2days 
Anticipation, scoring 12 syllables 67.8 50.2 39.0 17.8 10.0 


. = 36 letters 70.2 54.2 41.6 19.7 = 


That there is a positive difference at each interval in favor of 
the number of letters indicates the existence of partial retention 
which is not ready enough for successful anticipation but which 
is nevertheless effective. One might anticipate this tact from the 
nature of the case, quite independent of the magnitude and the 
probable error of the difference. Such partial retention may be 
due to one of two causes, or to both. (1) One part of a syl- 
lable may be forgotten more rapidly than another part. (2) The 
association link may be so weakened that it cannot be reinstated 
within the short time limit of 2 sec. We shall later see that ex- 
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tending the time limit for recall increases the score by a far 
greater amount than does the present process. A time limit is 
detrimental to partial retention. 

It is important to notice that by scoring the number of letters 
instead of syllables, the shape of the curve is not materially 
changed. In Fig. III, the curves for the number of syllables and 
for the number of letters may be compared by direct inspec- 
tion. 


2. The Difference between Scoring the Whole Series With and 
Without the First Syllable. 

This was done on a priori grounds. Apparently, there seems 
to be a difference between the anticipation of the first syllable of 
the series and of the other eleven. For each of the eleven, antici- 
pation is facilitated by that part of the series which is already 
exposed. The associative bond is aroused by so many “cues,” 
such as visual, auditory and vocal, which are not available for the 
first syllable. Such is not the case with written reproduction. 
For there the subject may begin from any point of the series and 
run forwards and backwards. 

Specifically speaking, the ground for singling out the first 
syllable of the series is perhaps insecure. Association is effective 
not only between immediately consecutive syllables, but also in 
the most criss-cross way imaginable.° So even the recall of the 
first syllable will be helped by the anticipatory re-instatement of 
the succeeding members. But in general, one may consider the 
association between two like members of a series as quantitatively 
different from that between one of these members and another 
dissimilar factor. oe 

When the first syllable was thus excluded, we obtained the 
comparative results of Table IX. 


TABLE IX 
2omin. thr. 2hrs. tday 2days 
PGP 28 GOMADIOS. «0 cc ccccescatcces 67.8 50.2 39.0 17.8 10.0 
= on eg EE ee ee 64.9 40.0 32.0 13.0 8.3 


Quite beyond our expectation, the averages for 12 syllables ex- 
ceed those for 11 at every interval. The first syllable was more 


5 Cf. Ebbinghaus, Op. cit., Ch. IX. 
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often correctly anticipated than the average of the other 11. 
Thus the lack of associative “cues” seems to be more than com- 
pensated by the favorable effect of primacy, and our a priori 
conclusions become groundless.. 

3. The Difference between Scoring and Not Scoring Position 
and Sequence in Written Reproduction. 

As already stated, written reproduction was scored (1) as to 
the gross amount of retention and (2) as to that factor plus 
position and sequence. In the latter case, the gross amount was 
scored % and position and sequence % each. The comparative 
results are presented in Table X. 


TABLE X 
2omin. «hr. 4hrs. t«day 2days 
With position and sequence....... 80.3 73.1 50.3 32.5 22.6 


Without position and sequence.... 88.1 82.1 60.5 39.2 26.7 


Scoring position and sequence apparently decreases the amount 
of retention. It is, of course, much more probable for a syllable 
to be reproduced than to be reproduced in the original position 
and sequence, On the other hand, it is also remarkable that there 
are not so many instances in which a syllable is remembered as 
to its position and sequence but only vaguely in specific content. 
The above differences would certainly be more prominent if we 
had taken into account the extent of chance in our method of 
scoring. 

Later we shall see that the decrease in the amount of retention 
due to scoring position and sequence is not limited to the con- 
ditions of this series of experiments. The phenomenon was repro- 
duced in a second series of experiments in which the degree of the 
original learning was varied. Still the difference in amount is 
not such as to change the general shape of the curve. Compare 
Fig. III for this series of experiments. 

4. The Difference between Scoring Preliminary and Final 
Records. 

In describing the methods of scoring, we mentioned that rec- 
ords were taken of the amount of error in written reproduction, 
of the amount of material recalled upon the lapse of preliminary 
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time limits in recognition and written reproduction and of the 


amount of time spent in the whole process of recall in recognition, - 


reconstruction and written reproduction. These results will be 
presented and compared in another section. 

5. Corroborative Data from the Second Series of Experi- 
ments. 

In the second series of experiments, the Reproduction, Recog- 
nition, and Reconstruction methods of testing results were used 
when the material was learned with different degrees of mas- 
tery. When the degree of learning was exactly the same as in 
the first series of experiments, the two series of values cor- 
roborated each other to a remarkable extent. The values tor 
both series of experiments are presented in Table XI. A fuller 
description of the conditions of the second series is to be found 
at the beginning of Chapter III. 


TABLE XI 


20min. thr. 4hrs. tday 2days 
Written reproduction 


Ist series of experiments...... 88.1 82.1 60.5 39.2 26.7 
2d series of experiments...... 90.6 85.8 64.8 45.6 40.2 
POON. 6.6 CAI Os 89.4 84.0 62.6 42.4 33.5 
Scoring position and sequence 
Ist series of experiments...... 80.3 73.1 50.3 32.5 22.6 
2d series of experiments...... 86.5 81.2 58.0 37.5 33.5 
PEE iors Skee BAe ede owt 83.4 77.2 54.2 35.0 28.1 
Recognition 
Ist series of experiments...... 97.8 94.6 93.3 74.6 71.5 
2d series of experiments...... 95.8 95.0 91.6 77.6 78.9 
PRINS 6 ie OBSTET e ven 06.8 94.8 92.5 76.1 75.2 
Reconstruction 
Ist series of experiments...... Q1.5 89.7 75.4 50.9 38.6 
2d series of experiments...... 89.3 90.4 74.9 48.6 44.0 
PEVGUEN oo ech ieee tees 00.4 - 90.1 75.2 49.7 41.3 


For the shorter intervals, the validity of either set of values 
is self-evident and beyond question. But the difference between 
the two sets increases with the length of the interval. This fact 
is to be later considered as a characteristic of individual differ- 
ences in the ability to recall. 

In written reproduction, when position and sequence were 
scored, the values of the first series were not so closely repro- 











en 








28 C. W. LUH 


duced in the second series tor the short intervals but more 
closely reproduced for the long intervals. The validity of. the 
long interval values is questionable. As to the short intervals, 


we have already stated that the method of scoring position and 
sequence is not very reliable. 


COMPARISON AND INTERPRETATION OF DATA 


From Fig. II, two general phenomena are easily observable. 
(1) The curve for relearning does not fall as rapidly as the other 
curves and it intersects with the reconstruction and written 
reproduction curves as the length of the interval is increased. 
Were it possible to fit each series of empirical data to an ideal 
curve or family of curves, one would still be confronted with the 
difficulty that relearning does not satisfy quite the same type of 
equation as the other memory processes. By increasing the num- 
ber of constants, we might represent all the series of values by 
a general logarithmic equation which applies to all conditions, 
but our ignorance of the actual and specific course of forgetting 
would be as profound as ever. Suppose that the values of all 
the constants are given or calculated, which is a wild supposition 
in the light of our present knowledge of memory processes. We 
could then be sure of only one thing, viz., Relearning and the 
other processes do not satisfy the same type of logarithmic equa- 
tion. 

(2) With the exception of the relearning curve, the other 
curves are more or less similar. The similarity becomes more 
prominent at the end of the 4-hr. interval. It may even be said 
that after the lapse of that interval, the difference between any 
two memory processes except relearning and probably recogni- 
tion, measured at any time, is a definite amount which is con- 
stant for those two processes. Recognition is in many respects 
similar to relearning. It favors the longer intervals and partial 
retention. 

This similarity of the curves is reproduced in the second series 
of experiments, as may be seen in Table XI. 
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(1) Comparison of the Relearning and the Other Curves. 

One possible reason for the disparity as discussed under (1), 
one might assume, may be traced back to defects in the methods 
of measurement, which do not take into enough consideration 
the amount of partial retention. As we shall later develop, the 

processes of memory fade away gradually, from complete reten- 
- tion to bare recognition. One may thus be led to expect that the 
amount of partial and uncertain retention increases in direct 
proportion to the length of the interval. Could we devise a finer 
method by which each memory process is measured in its 
entirety, the score for each interval would be increased by the 
amount of partial retention. But the increment would make very 
little difference in the shape of the curve for the shorter intervals 
when the total amount of partial retention is rather small; and in 
fact, we see that the fall of the relearning curve is similar to the 
others for the short intervals. In other words, the defects in the 
methods of measurement could not be so easily detected when the 
interval is short. For the long intervals, these defects could be 
remedied only by carefully scoring the amount of partial reten- 
tion. Since the latter is thought to increase with the time inter- 
val, the results thus scored would manifestly be a curve which 
slopes down much less abruptly and approaches a type like that 
of relearning. 

Now the argument as here presented assumes at least two 
things. A. A more accurate method of measurement will bring 
to light the amount of partial retention so much so that the shape 
of the curve will be changed. B. The amount of partial retention 
increases with the time interval. 

As to B, we suggest that this assumption is not always true 
and shall try to demonstrate the fact in Ch. IV. 

Assumption A seems more plausible only because we cannot 
develop a method of such magical accuracy. If the methods of 
measurement were the only faulty factor, then the improvement 
of technique by way of refining these methods would in propor- 
tion make the other curves approach more closely the relearning 
type of curve. However, within the limits of our investigation, 
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the shape of the curves do not materially change on account of 
minute variations in the methods of measurement. The follow- 
ing facts indicate that the differences under consideration are 
more fundamental than merely a matter of technique. 

(a) In anticipation, scoring the number of letters as well as 
syllables increases the value by including partial retention, but 
the increments are not such as to make the curve fall less rapidly 
than does scoring the number of syllables alone (Fig. III). 

(b) In written reproduction, scoring position and sequence in 
addition to the amount of reproduced material does not change 
the shape of the curve very appreciably. When position and 
sequence are not scored, more allowance is made for partial re- 
tention, for a syllable which is retained only as to its content 
and not its relative order is scored as much as one which is 
completely retained. According to the proposed theory, scoring 
position and sequence would make the curve fall much more 
rapidly. This is not a fact. 

(c) In recognition and written reproduction, as will be dis- 
cussed later on, extending the time limit for recall so as to make 
more room for the reinstatement of partial retention does not 
change the general shape of the curve, though the increment of 
the score after the extension of the time limit in recognition does 
increase with the length of the interval so that the curve slopes 
toward the abscissa more gradually. (For recognition in the 
first series of experiments, see Fig. IIT.) 

Thus, scoring partial anticipation, neglecting position and 
sequence in written reproduction and, finally, extending the time 
limit for recall all fail to eliminate the apparent difference be- 
tween the relearning curve and the other curves. The assump- 
tions of the theory cannot be substantiated. 

It is doubtful whether the relearning curve can be directly 
compared with any of the rest. Relearning, being a composite 
method, may be analyzed into anticipation and subsequent learn- 
ing. Most probably, the subsequent learning is a function of the 
amount of anticipation. The more the amount of anticipation, 
the less the number of presentations necessary for relearning. 
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If any such causal connection be found to be generally valid, then 
the relearning values can be constructed from the original learn- 
ing and the amount of anticipation. Only such analysis could 
bring out any natural relationship that may exist between the 
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amount of retention and the time necessary for relearning. For 
the present these two factors cannot but be treated as independent 
values, particularly for the following reason. 

The values for relearning are based upon the time of learning 
and relearning, the proficiency of retention being measured by 
a ratio of time; while the values for the other curves are built 
on an almost totally different criterion. With the latter, the 
standard of proficiency is not the length of time, but the ability 
to retain the whole series, and different degrees of retention are 
measured as steps approaching that standard. 

For this reason, the time for relearning cannot be interpreted 
in terms of the amount of retention, but both must be taken into 
consideration in order to understand the phenomenon of reten- 
tio. quantitatively. A score made by the “saving method” can- 
not be converted into another score except as to mean the amount 
of time saved. As to the measurements for the amount of re- 
tained material, the same course of reasoning will lead to the 
conclusion that these measurements do not indicate anything as 
to the relative difficulty experienced in mastering the material. 
For instance, 60% of retention is three times as high as 20% 
with respect only to the actual amount of material; it explains 
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nothing as to how it was acquired, or how much it is really worth 
as compared with another amount acquired with the expenditure 
of a larger or smaller amount of time. 

Perhaps a consideration of the shape of the learning curves 
for memory as involved in the relearning method will bring 
to mind more distinctly the disparity between the two standards 
of measurement, namely, time and amount. If in both learning 
and relearning, the effect of each presentation of the series upon 
learning were constant, the learning curves would then satisfy 
equations of the first degree such as hypothetically represented 
in Fig. 1V. Further, if the effect were constant for relearning 
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after any time interval and with any amount of actually retained 
and reproduced material, then the curves would be parallel. In 
such a case, the amount of retention would be a function of the 
time necessary for relearning, and vice versa. For, referring to 
Fig. IV, the amounts of retained material after different time 
intervals are YoY;, YoYo, etc. Correspondingly, according to the 
“saving method,” the percentages of retention and forgetting are 
calculated according to distances on the line parallel to the ab- 
scissa which represents the number of presentations necessary 
for learning or relearning. X,Y, is the number of presentations 
in learning. X;Y, is the number of presentations necessary 
for relearning after the lapse of an interval when the amount of 
retained material as represented on the ordinate, is YoY3. The 
percentage of forgetting for that interval is X; Y, / Xo Y,. It 
corresponds to the amount Y; Y,. Similarly, X, Y, / Xo Y, cor- 
responds to Y. Y., X: Ys / Xo Y4 corresponds to Y, Y,, etc. It 
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is clear that since the learning curves are supposed to be parallel, 
the percentages of forgetting, or of retention, thus calculated 
from the abscissa would always be proportional to the percentages 
calculated from the ordinate. Then the curves of retention based 
upon the “saving method” and upon the amount of recalled 
material would be similar, when plotted on the same scale. 

As a matter of fact, the learning curves for memory are not 
parallel straight lines. Practically all the curves so far deter- 
mined are negatively accelerative, including especially the recent 
work of Kjerstad.° This is also corroborated by our own re- 
sults in both learning and relearning. The degree of negative 
acceleration in the relearning process also varies with the time in- 
terval or the amount of actually retained material. That is, if 
the curves follow the same law of negative acceleration, they can 
then be represented as in Fig. V. In the figure, Y; Y., Y2 Y4, etc. 
represent respectively the amounts of forgetting after different 
time intervals, X; Y4, X. Y,4, etc. represent respectively the cor- 
responding number of presentations necessary for relearning for 
each of the assigned time intervals. From that figure, two facts 
become self-evident. 

a) Not only do X and Y differ in the scale and unit of measure- 
ment, but the functional relationship between the two is not so 
simple as that represented in Fig. IV and not such as could be 
easily determined. Referring back to Fig. II, this difference in 
the units of the scales and this complex and unknown functional 
relationship between them would mean that the absolute height 
of the retention curve for relearning, as compared with that of 
the other retention curves, cannot be interpreted by mere inspec- 
tion. The absolute values of the curves cannot be directly com- 
pared. 

b) But the more significant fact is that these very character- 
istics of the learning curves will directly lead to the particular 
difference between the shape of the relearning curve for retention 
and of the other retention curves, as seen in Fig. II. In Fig. V, 
the number of presentations, X;Y,, X2 Y,, etc. increases at first 
more rapidly than the corresponding amounts of forgetting, 

8 Op. cit. 
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Y; Yu, Y2 Ys, etc.; but less rapidly when the amount of actually 
retained material is small, 7. e., when the time interval is increased. 
Now if we plot the values on the ordinate against the variable 
of time in such manner as manifested by the retention curves 




















Xs Xe xX, X. 
lie 
Ys 
% 
Y 
7, —— A 
Fig = fig 


for the amount of reproduced material (A), and if we further 
draw acurve (B) for the retention values as determined from the 
abscissa on the basis of (A), their relationship will be such as 
given in Fig. VI. The difference between the two is exactly what 
we observed in Fig. II. 

Thus, the difference between the relearning curve for reten- 
tion and the other retention curves is not due to the phenomenon 
of retention as such, but to the characteristic of the learning 
curve, If the latter were invariably a simple logarithmic curve, it 
would necessarily follow that the forgetting curve as determined 
by the “saving method” would be logarithmic. When this rela- 
tionship obtains, as claimed by most of our predecessors, it is 
important to remember that, 

a. The curve of forgetting for the saving method is logarith- 
mic only because it involves the ratio of two logarithmic learning 
curves. 

b. Similar phenomena cannot be expected to reappear when the 
same factors are not involved. 


The Unsatisfactoriness of the Relearning Method. 


It is now evident that neither time nor amount is a complete 
measurement for retention, but both are not equally convenient. 
A. The first unsatisfactoriness of the relearning method is that 
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it achieves much less validity of data for the same expenditure 
of time as compared with the other methods. 

As a test for validity, we use the mean deviation of the values 
of all the series which a subject learns or reproduces for each 
specific interval. This M. D. may be made directly comparable 

100 M. D. 


Median © 
The greater the coefficient V, the less is the validity. Five of 
the subjects learned five series for each of the five intervals in 
the first series of experiments. Five is a ridiculously small num- 
ber for such statistical treatment. If, however, all the results 
point uniformly in one direction, most probably there is an actual 
difference in the degree of validity of these values. Table XII 
presents the results for only two intervals, 20 min. and 1 hr. 
Beyond that, the variability of the relearning method becomes so 
large as to make such comparison superfluous and meaningless. 
A ? mark indicates that, of the two intervals and the two par- 
ticular methods compared, the coefficient of variability is larger 
for one method at one interval, and for the other at the other. 
In a similar way, a + sign means larger variability for relearn- 
ing at both intervals. 





with other M. D.’s by applying Pearson’s formula V = 


TABLE XII 
SUBJECT ANTICIPATION RECOGNITION RECONSTRUCTION  W. REP. 
D ? + —- ? 
Le ? ? -- 
Lo ? + sd ? 
R ? ? ? 
W ? + + 2 


Of all the paired comparisons, none is distinctly in favor of 
the relearning method. Its coefficient of variability is higher 
than that of any other method. That is, for equal expenditure of 
time and energy, relearning produces less satisfactory results than 
does any other method. 

B. In addition to the above, the relearning method makes im- 
possible certain correlation studies which are easily accessible to 
the other methods. Questions like the following have to be 
answered one way or another. (a) What is the relation between 
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the speed of learning and the amount of retention for each inter- 
val? (b) For all the series learned by the same subject, what is 
the relation between the difficulty of learning and the amount 
of retention, etc.? As to question (a), the problem of the cor- 
relation between “immediate” and “permanent”? memory has 
claimed a goodly number of working days. Very little has been 
written on question (b), but Ebert and Meumann’ once raised the 
problem whether subject matter that is readily learned is forgot- 
ten more rapidly or more slowly than that which requires greater 
labor in memorizing. In dealing with these problems, the re- 
learning method was generally used. Relearning, as we already 
discussed, involves two learning processes. Suppose a number of 





syllable series to be learned in X, X’, X”, . . . presentations 
and relearned in Y, Y’, Y”, . . . presentations. The amounts 
; : Y a’ y" 
of forgetting will be : ; , . . . Learning and 
x? x” 
forgetting involve the same factor X, X’, X”, . . . That fact 


deprives any correlation study of its real significance. If it is 
further argued that the percentage of retention is determined by 
X—Y, X’—Y’, X”—Y”, : . . .which are independent values, 
we suggest that these values can be more reasonably established 
by some other methods which directly measures the amount of 
reproduced material. 7 

(2) Comparison of the Curves which Represent Only the 
Amount of Reproduced Material. 

We have explained why the relearning and the other curves are 
different in general form, and now proceed to the problem why 
these other curves differ in absolute numerical value. But we 
cannot treat the problem without first proving that the numerical 
differences are real and not adventitious. 

First, we can refer back to the data for each individual sub- 
ject, which constitute the group averages. From the group 
curves, recognition has a higher value than reconstruction for 
each of the five intervals. The same relation holds for recon- 
struction and written reproduction, and for the latter and antici- 


7™“Ueber einige Grundfragen der Psychologie der Uebungsphenomene im 
Bereiche des Gedachtnisses,” Archive f. Gesamte Psy., Vol. IV, 1904, pp. 193-4. 
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pation. This particular order of proficiency for the several 
measurements of retention holds true for the majority of the 
subjects. Thus, of the 20 individual values, 10 from each series 
of experiments, which constitute the final recognition score for 
the 20 min. interval, only one is higher than its corresponding 
value which goes to make the final score for reconstruction for 
the same interval, etc. Table XIII presents these facts in brief. 


TABLE XIII 


PERCENTAGE OF INDIVIDUAL CASES WHICH CORRESPOND TO 
Group RESULTS 


20min. thr. 4hrs. tIday 2days 


Anticipation cf. written reproduction* 100 100 87 87 75 
Written reproduction cf. reconstruction 60 75 75 70 65 
Reconstruction cf. recognition ...... 95 80 95 95 95 


* Only 8 values from 8 subjects in the 1st series of experiments. The rest 
are constituted of 20 values from 20 subjects in both series of experiments. 

Secondly, the validity of the numerical differences may be 
proved by the magnitude of their probable errors, as presented in 
Table XIV. 


TABLE XIV 


2omin. thr. 4hrs. t«day 2days 
Difference between 


Antic. and Wr. Rep............ 20.3 31.9 21.5 21.4 16.7 
ic Oe GIS a inn <a no eccen 4.5 3.7 5.5 7.0 6.1 
Difference between 

Wr. Rep. and Reconstruction... 1.0 6.1 12.6 7.3 7.8 
ates: OE GOOD 5 iin bse Gi es os 1.1 1.7 2.7 4.5 4.3 
Difference between 

Recons. and Recognition...... 6.4 4.7 17.3 26.4 33-9 
ap ne ee 1.5 1.9 2.2 4.3 4.3 


The P. E. of the difference between reconstruction and written 
reproduction can be reduced by increasing the number of subjects. 
In other words, the values for reconstruction and written repro- 
duction may be slightly changed with the increase in the number 
of subjects, especially for the 20 min. interval. That there 
is a positive difference in favor of reconstruction at each of the 
intervals is unmistakable. The validity of all the other differences 
is self-evident. 

Returning now to the group curves, we further find that, while 
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after the lapse of the 4 hr. interval the course of the curves be- 
come more or less parallel, such is not the case for the shorter 
intervals. There the decreases in value are more abrupt for cer- 
tain curves than for others. On the whole, the one that begins 
the lowest at 20 min. falls the most rapidly so that the curves 
become farther and farther apart as the length of the interval 
increases. So the Ebbinghaus tradition is substantiated by our 
data to that extent. 

However, the negative acceleration theory of the curve of for- 
getting does not hold for all of our values. The two notable 
exceptions, as may be seen from pp. 21-22 are: 

1. In recognition, the transition from 1 hr. to 4 hrs. is much 
less accelerative than that between 4 hrs and 1 day. 

2. In written reproduction, the curve approaches a straight 
line between 20 min. and 4 hrs. 

A significant fact is that these exceptions in the first series of 
experiments were reproduced in the second series. Further, im- 
posing a time limit upon the act of recognition and scoring posi- 
tion and sequence in written reproduction did not in the least 
ameliorate these peculiarities. Is the curve of forgetting a loga- 
rithmic curve, as has been repeatedly maintained? These facts 
must be taken into consideration and explained. 

One must also remember the course of the curves after the 
lapse of the 4-hr. interval, as described in a preceding paragraph. 
What is its bearing on a general logarithmic equation? 

From the above, we may still conclude that, of two memory 
processes, the one that commands a higher “initial” amount of 
forgetting tends to fade away more rapidly than the other. This 
acceleration approaches a limit at the end of 4 hrs., and does not 
resume its initial course even to the end of 2 days. 

One word as to what is meant by an “initial” amount of for- 
getting, a term first used by Bean. When retention is measured 
at the end of 20 min., we see only a cross-section of the stream of 
forgetting, to use James’ old metaphor. From our data we can- 
not determine whether the grade of the headwaters is steep or 
level, or where the grade actually begins. _In other words, we do 
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not know what the “initial” amount of forgetting is, for each 
process. The quantitative differences as we measure at the end 
of 20 min. may doubtless be traced back to differences of the 
same kind. We assume that, if at 20 min., retention as measured 
by the anticipation method is less than by the recognition method, 
this was also true for shorter periods than 20 min., though not in 
the same ratio and by the same amount. But in fact, forgetting 
for one process may not begin at the same point as for another. 

This is particularly true for written reproduction, recognition 
and reconstruction. When the method of presentation in the 
original learning is different from the method of testing, we can 
no longer compare directly the amount of immediate retention 
with the values that determine the curves of forgetting. In anti- 
cipation and relearning we know that the amount of retention 
immediately after learning is 100% so that we can trace these 
curves back to Yo, 1. ¢., where the length of the interval is o. 
But in the other three methods, the forgetting curves begin at 
20 min. and we cannot go back any further. It is perhaps un- 
fortunate that we did not vary the methods of the original learn- 
ing as well as the methods of testing, but then we would have 
introduced another constant and would have made our data 
more difficult to interpret. 

Very likely, the quantitative differences between any two pro- 
cesses measured at any time may be greatly reduced by trans- 
posing the curves so that the points of “initial’’ forgetting coin- 
cide. All this may be empirically determined. Unless such 
problems are solved, the term “initial” forgetting will remain 
as meaningless as the “logarithmic” curve of forgetting. 


Possible Explanations for the Quantitative Differences. 


The conditions are complicated. Perhaps no single explana- 
tion is sufficient, but the following are more than likely. 

1) The temporal order in which the methods were applied. 
In one half of the series given to each subject, anticipation was 
tested before relearning. In the other half, written reproduction 
was the first test applied. Recognition followed after written 
reproduction, and reconstruction after recognition. The high 
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retention values for recognition and reconstruction and the low 
values for anticipation and written reproduction may partly be 
due to the presence or absence of a preceding recalling process. 
For the present, we cannot determine whether that effect actually 
exists and to what extent. It is probable, however, that the 
effect of a preceding recalling process may simply reduce the 
duration of the succeeding recalling process without changing 
the amount of recall of the latter. In Ch. VI we shall see that 
the average duration of the written reproduction process was 
longer than for recognition, and the latter longer than for re- 
construction. It is possible, of course, that a preceding recall- 
ing process affects both the amount and the duration of a suc- 
ceeding one. 

Apparently, the explanation does not cover all the facts. Re- 
construction followed after recognition but gave much the 
smaller values. 

2) The duration of the several processes. The duration of 
the anticipation process was 24 sec.; that of written reproduc- 
tion, 5 min.; while recognition and reconstruction did not have 
time limits. So the order of the numerical values corresponds 
to the order of the duration of the processes. But as we shall 
later discuss in full, it took the average subject much less than 
5 min. to complete the written reproduction process. The actual 
duration of recognition was not half as long as written repro- 
duction, and that of reconstruction was still shorter. The actual 
differences in duration are not proportional to the numerical 
differences in the retention values. Written reproduction had 
the longest duration but gave the lowest retention values except 
anticipation. 

3) Differences in the units of measurement. In anticipation and 
written reproduction, the scores were based upon the amount of 
reproduced material. The requirement of the recognition method 
was merely that the different members be re-instated upon the 
presentation of the original series. In reconstruction, only po- 
sition and sequence were required. The implication would be 
that the numerical differences under discussion cannot be taken 
too seriously. 
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However, this kind of explanation is, in a way, begging the 
question. In written reproduction, recognition and reconstruc- 
tion, we scored the same records for different values. Were the 
scales and units identical, we could not have had more than one 
value. The required explanation is this: Given different methods 
of scoring the same records, why do the results differ in such a 
characteristic way? The proposed explanation only tells us that 
we should not have used those methods. So we are led to the 
fourth probable explanation which seems to us to be most rea- 
sonable. 

4) The conditions of recall. The experimental situations un- 
der which the subject was required to recall were vastly different. 
Our measurements took into consideration, among other things, 

a) The retention of the separate parts of a serial act of 
memory as called for by 
(a) Written reproduction, and 
(b) Recognition. 

b) The associative links that connect and combine these 
parts. 

c) The readiness with which they are recalled, as measured 
by 
(a) The amount of time necessary for recall and 
(b) The amount of material recalled within a given 

time limit. 

These factors are not equally important in all the methods of 
measurement. The number of these factors involved and the 
extent to which they are involved determine the quantitative dif- 
ferences. Thus, by order of the difficulty of recall, (Figs. II and 
III), the four methods are ranked : 

1. Anticipation. 

2. Written reproduction, scoring position and sequence. 
2a Written reproduction, not scoring position and sequence. 
3. Reconstruction. 

4. Recognition, with time limit. 

4a Recognition, without time limit. 
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Analyzing the number of factors involved, they follow: 

1. Anticipation. Factors a) and c) are both important. b) 
is necessary for complete re-instatement, but once a 
mistake is made, it is automatically corrected by the 
exposure of the syllable. 

2. Written reproduction, ‘scoring position and sequence. 
Factors a) and b) are equally important. c) is in- 
volved only to the extent of being able to reproduce 
the material within 5 min. 

2a Written reproduction, not scoring position and sequence. 
The conditions are the same as in 2, minus b). 

3. Reconstruction. Only b) is involved, being the comple- 
mentary of 2a. 

4. Recognition, with the time limit. a) is only slightly in- 
volved, b) not at all and c) only to the extent of being able to 
select the 12 syllables within go sec. 

4a Recognition, without time limit. Only a) is partly in- 
volved. 


From this we conclude that 

1. The quantity of recall depends upon the number of restrict- 
ing factors in the recall situation. The greater number of such 
factors and the more exactingly they operate, the less the amount 
of recall. | 

2. The proportionality between the number of such factors and 
the amount of recall is an index to the practical validity of our 
methods of measurement. The scores given by these methods are 
directly comparable. 


It is, therefore, meaningless to say that forgetting in general 
follows a certain equation. There can be as many curves of for- 
getting as there are situations and methods of measurement. 
We know almost nothing as to the “initial’’ amount of forgetting 
and very little as to the general shape of any curve. It may be 
harmless to say that forgetting is a logarithmic function of time, 
so long as we remember that the significant thing that should 
influence future investigations is not the logarithm, but the de- 
termination of the constants. The latter we cannot deduce from 
generalizations, but can only measure under variable conditions. 





III. RETENTION AS A FUNCTION OF THE 
DEGREE OF LEARNING 


In the second series of experiments, the condition that was 
varied was the degree of the original learning. The ten subjects 
of the second group served throughout these experiments, each 
learning at least 44 syllable series, besides preliminary practice 
trials. The series and the degrees of learning were distributed 
according to the following scheme. 

1. Altogether we used four degrees of learning. 


100% learning, with the same conditions as in the first 
series of experiments. 

150% learning, in which the subject was given one 
half of the number of presentations in addition to 
what was required for the first errorless anticipation 
of aseries. Thus, if a series was learned in Io pres- 
entations, 5 more were given. If 9, also 5. 


C. 67% learning. The average number of presentations 


was calculated for each subject after he had learned 
20 series besides the preliminary trials. In 67% 
learning, he was given two-thirds of that number of 
presentations. (The average number was previously 
taken to be the total number minus one, 1.e., the num- 
ber of presentations in which there was actual antici- 


pation. In the present case, the total number was 
used. ) 


D. 33% learning. By the same process of computation, 


one-third of the total number of presentations was 
given. 


2. In 100%, 67% and 33% learning, the intervals used were 
the same five as in the first series of experiments. Two of these 
were omitted for 150% learning, but four others were added. So 
there were seven intervals for 150% learning, viz., 2 hrs., 3 hrs., 
4 hrs., 6 hrs., 12 hrs., 1 day and 2 days. The 2-hr. and 3-hr. 
intervals were arbitrarily chosen after they had been tried out 
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on several subjects. The object was to select such intervals as 
would facilitate the comparison of the retention curves for 150% 
learning with the other curves from the same series of experi- 
ments. 

Two series were given each subject for each interval and each 
degree of learning. All the series for 100% and 150% learning 
except the 2-hr. and 3-hr. ones were completed by each subject 
before he tried 67% or 33% learning. The average number of 
presentations for learning these 20 series furnished the required 
basis of computation for determining 67% and 33% learning. 
The 2-hr. and 3-hr. intervals for 150% learning were added at 
the end of the whole series of experiments in order to trace the 
curves of forgetting further back toward the ordinate. One 
extra 6-hr. series was given each subject also toward the end of 
the experiments in order to counteract the effect of diurnal 
variations. 

For each degree of learning, care was taken to distribute the 
long and short intervals evenly. 

Only the written reproduction, recognition and reconstruction 
methods of measurement were used in recall. 


QUANTITATIVE DATA 


The results of the experiments are tabulated in Table XV and 
graphically presented in Figs. VII-IX. 


TABLE XV 
20min. thr. 2hrs. 3hrs. 4hrs. Ohrs. i2hrs. 1d. 2d. 
Wr. Rep. 
150% learning. . 88.0 844 81.9 65.6 544 385 308 
SPCR a 90.6 85.8 64.8 45.6 40.2 
BE aus nakeec 85.4 72.5 65.8 41.5 248 
Se Stak enass 67.7 54.0 42.7 26.2 13.7 
Recognition 
BO Sins riedes 9755 958 933 916 925 832 728 
Ee cicinkceve 95.8 95.0 91.6 776 78.9 
SO she ccceas 93.2 ° 93.3 84.7 9.9 Gis 
ye eee 73:3 64.4 54.6 45.7 25.5 
Reconstruction : 
SN 4 cede eade 87.5 921 908 789 81.3 43.4 43.0 
SE du cawascs 80.3. 90.4 74.9 48.6 44.0 
AOR RR es 92.0 77.9 65.3 56.6 318 


BR igi atisaes 75.6 61.9 48.1 26.0 20.0 
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1. The Range of Differences. 


/ As may be seen from Table XV, recognition, as a rule, gives 
the highest value for each interval and for each degree of learn- 
ing.| Reconstruction generally occupies the second place and 
written reproduction the last. Now if we take the difference be- 
tween the highest and the lowest values for each interval and 
for each degree of learning, we can make a comparative study 


of the range of the differences. The facts are presented in Table 
XVI. 


TABLE XVI 
RANGE OF DIFFERENCES 
20min. 8 hrs. 4 hrs. I day 2 days 


OED sdaeddipe cs decsdanes 7.9 10.4 11.9 19.5 12.8* 

SP. teed bivens onaes nnd ee: 20.8 19.4 17.1* 36.7 
I badd ie css fbb ueutaws 6.5* gan 26.8 28.0 38.7 
as «5 emirate Diaticn pa 44.7 42.0 


In this table the highest value for each interval is underlined 
and the lowest marked with an asterisk. The tendency is for 
the highest value, 7. ¢., the greatest range, to occur at the shorter 
intervals for the lower degrees of learning and at the longer 
intervals for the higher degrees of learning. The tendency for 
the occurence of the smallest range is vice versa. These facts 
reflect the characteristic way in which the different retention 
curves approach the x—axis with the increase in the length of 
the time interval. 

In general, the above range of the differences increases with 
the time interval, but at different rates for different degrees of 
learning. Theoretically, a higher degree of the original learn- 
ing, of course, increases the amount of retention for all the 
methods of measurement. But it particularly favors the more 
difficult methods for the shorter intervals so that the range of the 
differences between the easiest and the most difficult methods is 
small. As the time interval is lengthened, this advantage rapidly 
disappears. So the different curves fall gradually apart, and the 
range of the differences increases accordingly. 
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\ With a lower degree of learning, the effect is generally to de- 
crease the amount of retention for all the intervals and all the 
methods of measurement, but the special advantage is on the 
side of the easier, not the more difficult, methods. This effect 
increases the range of the differences for the shorter intervals, 
or at least keeps it as large as for the higher degrees of learning, 
which means that the range will be proportionally greater An- 
other characteristic result of a lower degree of learning is that, 
while the curves for all the methods of measurement begin rather 
low, they fall very slowly and keep almost parallel to each other. 
The range of the differences is thus kept within a small varia- 
tion. For the higher degrees of learning, the curves fall at such 
different rates that they grow farther and farther apart. 

We have, therefore, at least three types of curves resulting 
from varying the degree of the original learning and at the same 
time using three methods of measurement. Type 1 begins high 
and falls slowly. Type 2 begins high and falls rapidly. Type 3 
begins low and falls slowly. In order to establish a general for- 
mula for all these types, the numerical differences must be more 
accurately determined. 


2. Increase in the Degree of Learning and Diminished Returns 
in the Amount of Retention. 


In Figs. VII-IX one can easily observe that the difference be- 
tween the curves for 33% and 67% learning is the greatest, that 
between the curves for 67% and 100% learning very much less, 
and that between the curves for 100% and 150% learning the 
least of all. The curves for 100% and 150% learning often cross 
each other so that it is sometimes difficult to tell whether an in- 
crease of 50% of learning actually resulted in any increase in the 
amount of retention. In written reproduction they cross for 
the first time at a point whose abscissa represents an 8-hr. inter- 
val. Previous to that point the difference between the curves is 
distinct. There is a more decided difference between the 100% 
and 150% curves for recognition and reconstruction. Table 
XVII presents the difference for all three methods of measure- 
ment and for all the intervals. The probable errors of the differ- 
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ences are not included. They are very high for the smaller dif- 
ferences. The larger differences are self-evident. 


TABLE XVII 


2omin. ihr. 4hrs. day 2 days 
Written Reproduction 


Difference 33 and 67%.... 17.7 18.5 23.1 15.3 11,1 
67 and 100%.... 5.2 13.3 "—I.0 4.1 15.4 
100 and 150%.... 17.1 —7.1 —9.4 
Recognition 
Difference 33 and 67%.... 19.9 28.9 30.1 28.0 36.0 
67 and 100%.... 2.6 1.7 6.9 3.9 17.4 
100 and 150%.... 1.7 5.6 tI 
Reconstruction 
Difference 33 and 67%.... 16.4 16.0 17.2 30.6 11.8 
67 and 100%.... —2.7 12.5 9.6 —8.0 12.2 
100 and 150%.... 15.9 —5.2 —0.I 


— sign indicates that, of the two values compared, the one for the higher 
degree of learning is numerically smaller. 


At the outset, one might assume that this phenomenon of 
diminished returns could be due either to (1) practice effect or 
to (2) difficulties in the original learning. 

(1) As the series of experiments occupied more than three 
months, the proficiency of learning for most of the subjects was 
somewhat improved. The extent of this improvement we shall 
develop in another section. After five weeks of practice in 100% 
and 150% learning, there is no wonder that they could now use 
the 67% of the average number of presentations to greater ad- 
vantage. The average number was calculated from the learn- 
ing of the first 20 series when the practice effect was still in- 
creasing. By this factor one might partly explain why the dif- 
ference between the curves for 100% and 67% learning is so 
meagre. 

But one cannot explain the still smaller difference between the 
curves for 150% and 100% learning by the same theory. Fur- 
ther, what is true of 67% learning is to a less extent also true of 
33% learning. The difference between the latter and all the 
other curves is the greatest of all. How could the assumed prac- 
tice effect have influenced 33% learning so differently? 

(2) When the degree of learning is reduced to 33%, the 
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amount of material originally learned is greatly decreased. One 
cannot be expected to retain what he never learned. So instead 
of giving the amount of retention for 33% learning as a per- 
centage of the whole syllable series, one might also argue that it 
should be stated as a percentage of the number of syllables 
actually learned. : 

The last statement, however, amounts to saying that instead 
of 33% or 67% learning, we should have had 100% learning. 
Doubtless we would then expect the resulting retention curve to 
coincide with the ordinary retention curve for 100% learning. 

In fact, the number of syllables actually reported is a very poor 
measurement of the degree or the amount of learning. The 
subject was required to learn the series by anticipation, spelling 
the syllables aloud. What he did not correctly report after 33% 
or 67% learning could very often be correctly reproduced even 
at the end of a comparatively long interval. This phenomenon 
was particularly manifest for the more efficient learners who re- 
quired only from I to 3 presentations for 33% learning. The 
effect of the last presentation in the original learning was not 
brought out by subsequent anticipation. When the total number 
of presentations was not more than I or 2, this last effect became 
increasingly important. Our records prove that the ability to 
recall without ofiginal correct anticipation occurred with more or 
less frequency for all the subjects. We may further mention 
that one of the subjects could not develop the habit of spelling 
aloud what he learned in the first few presentations. 

‘A far more plausible explanation for this phenomenon of 
diminished return is that the effect of the different degrees of 
learning upon the amount of retention follows the same sequence 


as does the learming curve for memory. If negative acceleration . 


is characteristic of the acquisition of immediate memory, as has 
been repeatedly proved, one may assume that the same phe- 
nomenon will reappear in the measurement of permanent memory, 
which differs from the former only by the introduction of a 
longer time interval. 

From the shape of the learning curves for memory, it has 
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been concluded that the phenomenon of diminished returns holds 


| (1) for immediate recall and (2) for all degrees of learning up 


to 100%. Wecan now state in the light of our data that, within 
the limits of our experiments, this phenomenon also holds (1) 
for delayed recall and (2) for more than 100% learning. 

However, even on this theory one can hardly explain the nega- 
tive differences in the amounts of retention between 150% and 
100% learning for certain intervals. In Table XV, the value 
for 150% learning is lower than for 100% learning at the end 
of 1 and 2 days for written reproduction; at the end of 2 days 
for recognition; at the end of 1 day for reconstruction. At the 
end of 2 days for reconstruction the values for the two curves are 
practically equal. It is impermissible to extend the law of nega- 
tive acceleration to cover these negative cases. One can hardly 
conceive of an increase of 50% of learning as resulting in an 
actual decrease in the amount of retention. In Chs. IV and V 
we Shall find that the characteristic deviations for 150% learning 
are not limited to these unexpected changes in the amount. There 
we shall offer a general explanation for all these facts. 

| With the exception of these peculiarities for 150% learning, 


the phenomenon of diminished returns seems to be quite as gen- 


eral for delayed recall as for immediate memory.| Naturally one 
would look for a common cause for both phenomena unless 
there are reasons for the contrary. We further maintain that 
the similarity between these effects is not a coincidence, but 
almost a mathematical necessity. Given the effect of diminished 
returns in the curve for immediate retention, one will have to 
make some wonderful assumptions for not expecting the same 
effect to appear in delayed recall. This may be clearly seen in 
Fig. X. The curves presented therein are hypothetical. 

When the phenomenon of diminished returns occurs with im- 
mediate memory, a simple way to state this fact is to give the gen- 
eral equation of the curve, y =a — e—*. When nothing is 
learned, the curve passed through the point of the origin. Hence, 

(1) y>==I—e™. 

The limit of y will be 1, ¢. ¢., the mastery of 100% of material 
regardless of the degree of over-learning. 








THE CONDITIONS OF RETENTION 51 


Supposing that the phenomenon of diminished returns did 
not reappear in delayed recall, the curve for the retention values 
corresponding to various degrees of learning would have to be 











fige 


either a straight line or one with positive acceleration. For the 
former, we have the equation y == mx + b. When nothing 
is learned, nothing is retained. Therefore, 

(2) y = mx. 

When the value of m is properly chosen, the curves will intersect 
with each other as in the figure. 

If instead of linear regression, there were more or less positive 
acceleration, we could also generalize the fact by stating the 
equation. P 

(3) y== Ax + Bx’ + Cr? +..... 

For certain values of the constants the curves (1), (2) and (3) 
will meet at the same point, which represents that for practical 
purposes the material is so well mastered that there can be no fur- 
ther forgetting. 

Now if we compare the curves between this point of intersec- 
tion and the point of origin by mere inspection, it becomes clear 
that for whatever values of the constants, the maximum differ- 
ence between (1) and either (2) or (3) will not occur in the 
immediate neighborhood of either of the points, but somewhere 
in the middle. 

Further, curve (1) is fixed. (2) is also fixed when the value 
of m is determined. Equation (3) is an endless series. x is 
positive. Assuming all the constants to be positive, then the 
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fewer terms we take, the more abrupt will be the change in curva- 
ture, such as curve (4) in the figure. 

From this description of the curves one can see that, given 
the effect of diminished returns in the learning curve for memory, 
the same effect will not appear in delayed recall only on one of 
these two conditions. : 

A. A certain medium degree of learning is the least effective 
with respect to the amount of retention. This amount will be 
increased with more learning and also with less learning. Or 

B. The degree of learning has no considerable effect upon the 
amount of retention. It remains very meagre for all degrees of 
learning until the latter attains a critical value when all of a 
sudden the amount increases to nearly 100% and forgetting dis- 
appears. 

Unless and until either one of the conditions is empirically ful- 
filled, the conclusion still holds true that the phenomenon of 
diminished returns 1s general for both immediate and delayed 
recall. |The learning curve and the curve constructed on the 
basis of the diminishing amounts of retention due to different 
degrees of learning are related to each other somewhat as (1) 
and (5). In the latter, the parameter assumes the value a, less 
than unity. : 

Ebbinghaus* long ago discovered this tendency of diminished 
returns, though this is not clearly stated in his monograph. Thus 
he found that the amount of retention after one day was a func- 
tion of the number of presentations used the previous day. That 
number was varied from 8 to 64, by intervals of 8. “For each 
three additional repetitions which I spent on a given day on the 
study of the series, I saved, in learning this series 24 hours later, 
on the average, approximately one repetition; and, within the 
limits stated, it did not matter how many repetitions altogether 
were spent on the memorization of the series.” In Sec. 34, where 
he treated retention as a function of repeated learning, he con- 
cluded, “The effect of the repetitions is at first approximately 
constant, the saving which results from these repetitions increases 
accordingly for a while proportional to their number. Gradually, 


1 Op. cit., Ch. VI, Sec. 22-23; Ch. VIII, Sec. 34. 
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the effect becomes less; and finally, when the series has become 
so firmly fixed that it can be repeated almost spontaneously after 
24 hours, the effect is shown to be decidedly less.” 

The last conclusion quoted above is self-evident, and clearly 
corroborates our results. The other statements may be mislead- 
ing. When the effect of the increase in the degree of learning 
upon the amount of retention is said to be “constant,” or to in- 
crease by arithmetical progression, it amounts to saying that, 
according to his “saving method,” it is negatively accelerative. 


100 (L—WL) 
The formula for the “saving method” is Q = T. , 


in which Q is the percentage of saving, L the time required for 
learning, and WL the same for relearning. The formula holds 
when L is equal to or greater than WL. When such is the case, 
a constant numerical increment to both the numerator and the 


Cet 3) Caos) 


L +3 
(L+6) — (WL—2) (L+9) — (WL—3) 


5 ren) See ee ae ’ 


L+6 L+o9 
will make each term increase in value, but its difference from the 
immediately preceding term decrease in value. The effect is thus 
negatively accelerative. 

When L is smaller than WL, as in incomplete learning, Eb- 
binghaus used as a basis for computation the hypothetical L that 
would have been spent had it not been for the previous incom- 
plete learning. The amount of saving was a percentage of that 
hypothetical L, thus neglecting the amount of time that was 
actually spent on the previous day. If this amount of time had 
been taken into consideration, then the effect of the increase in 
the degree of the original learning upon the amount of retention 
could be shown to be negatively accelerative throughout his in- 
vestigation. 





denominator such as in his experiment, 











3. A Further Word Regarding the General Shape of the 
Curves. 


In the last chapter the difficulties for stating a general equa- 
tion which would satisfy all the phenomena of forgetting were 
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fully elaborated. The reader is now referred to Figs. VII to IX. 
A general “logarithmic” equation must make allowance for the 
crossing and recrossing of the “families” of written reproduction 
and reconstruction curves. Some of these irregularities may in- 
deed be traced back to inaccuracies in the data and may not reap- 
pear in another series of experiments of the same kind, but we 
maintain that any mathematical statement of the Ebbinghaus 
tradition will require more experimental background. 

Perhaps the most embarrassing group of curves is that for 
recognition. It would be just as easy to fit the corresponding 
curves of forgetting to equations of the first degree as to more 
complicated logarithmic equations. These curves are more or 
less parallel, more or less approaching linear regression, and as 
often tending to positive as to negative acceleration. One thing 
we can definitely state is that, on the whole, they are not loga- 
rithmic. 

It was pointed out in the last chapter that relearning based on 
the “saving method” produces a type of curve vastly different 
from the results of the other methods which measure the amount 
of reproduced material. / Now it becomes further evident that 
among the latter group, recognition sometimes has its unique 
curves which are as different from those of the other methods as 
relearning is from all the rest. Under certain circumstances it 
may happen that each of these curves will take on a logarithmic 
form. Strong’s curve for recognition memory, for instance, is 
like Ebbinghaus’ curve for the “saving method,” and the former 
can certainly be used as illustrative of Bean’s generalized state- 
ment. We do not maintain that relearning, anticipation, written 
reproduction, recognition, reconstruction, etc., each has a general 
curve.. We only indicate that the logarithmic assumption and 
even the phenomenon of negative acceleration may totally dis- 
appear upon further investigation. | 

However, if the problem be put in such a way that we have to 
choose between Ebbinghaus and Ballard, then the former type of 
curve is much closer to our own results. 





IV. THE EFFECT OF EXTENDING THE TIME LIMIT 
FOR RECALL UPON THE AMOUNT OF 
MATERIAL RECALLED 


In written reproduction, as described above, a record was 
taken at the end of the first minute of recall and another at the 
end of the second minute, when the subject did not finish recall- 
ing within these time limits. These preliminary records, to- 
gether with the other records which were completed within 1 
or 2 min., may be taken as indicative of the proficiency of 
written reproduction memory up to I and 2 min. of recall re- 
spectively. 

In recognition similar preliminary records were taken at the 
end of go sec. without the subject’s knowledge. The difference 
between these 90 sec. records and the complete records has been 
referred to in Ch. II. 

We present in Table XVIII the comparative results for the 
written reproduction methods for four degrees of the original 
learning. The values for 100% learning are averages from both 
series of experiments. When the same written reproduction 
records were scored for position and sequence, the preliminary 
values were slightly changed. These values are tabulated in 
Table XIX to facilitate comparative study. Similar results for 
the recognition method are presented in Table XX. 


1. Comparison of the Written Reproduction Results. 

It was indicated in connection with a discussion on anticipa- 
tion and relearning that partial retention is not as readily recalled 
as complete retention. Within certain limits, the duration of 
the recalling process may directly correspond to the strength of 
the association. However, the tendency for the amount of recall 
to increase upon extending the time limit very soon becomes in- 
effective. One conclusion we can draw from Tables XVIII and 
XIX is that the effect of extending the time limit for recall with 
the written reproduction method becomes less and less important 
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beyond 1 or 2 min. The extension from 1 to 2 min. increases 
the scores by a far greater amount than does a further extension 
from 2 to 5 min. This particular effect is quite independent of 
minute variations in the method of measurement. Scoring po- 
sition and sequence does not in the least change the relative im- 
portance of the successive extensions of the time limit. The 


TABLE XVIII 


WrittEN REPRODUCTION, COMPARISON OF PRELIMINARYs AND 
Fina. Recorps 


2omin. th, 2h. 3h. 4h. 6h. 12h. I day 2days 
150% learning 


MG os cece 75.9 600 57.90 43.0 346 260 229 
Difference. . ae: 263. 2.. ta2 8.7 5.7 3.1 
DU. 08440 84.1 76.5 71.0 56.7 433 31.7 26.0 
Difference. . 26° e682 Ge aaa ae 
Complete ... 88.0 84.4 819 656 544 385 308 
Zetel DD... 23. -944..060 206 198.145. 378 
100% learning 
| hea 75.6 609.2 44.3 30.8 26.4 
Difference. . 105 108 11.5 7.3 3.8 
PU aiivsss 86.1 80.0 55.8 38.1 30.2 
Difference. . 3.3 40 : 6.8 4.3 3.3 
Complete .... 80.4 840 | 62.6 42.2 33.5 
Total D.... 13.8 148 18.3 11.6 7.1 
67% learning 
ee 60.8 47.7 42.5 31.7. 21.5 
Difference... 12.7 14.0 16.2 66 2.7 
PU i cies 82.5 61.7 58.7 38.3 24.2 
Difference. . 29 6110.8 7.1 3.1 6 
Complete .... 85.4 72.5 65.8 41.4 248 
Total D.... 156 248 23.3 or 33 
33% learning 
CR ikke 59.8 43.1 31.2 ts 189 
Difference. . 6.2 7.1 8.8 4.5 4 
POR 6 cave 66.0 50.2 40.0 26.0 13.1 
Difference. . 1.7 3.8 2.7 2 6 
Complete .... 67.7 54.0 42.7 26.2 13.7 
Total D.... 79 109 11.5 4.7 1.0 


latter also holds for all degrees of the original learning except 
for the 12-hr., 1-day and 2-day intervals with 150% learning. 
In these exceptional cases the second extension of three minutes 
seems to be more effective than the first extension of one minute. 
Two of these intervals, 1 day and 2 days, correspond to the points 
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TABLE XIX 


WRITTEN REpropucTIoN, COMPARISON OF PRELIMINARY AND FINAL 
Recorps, Scorinc Position AND SEQUENCE 


20min. th. 2h 3h. 4h. 6h. 1iI2h. tday 2days 
150% learning 


2 a ea 72.4 56.7 53.3 382 324 229 200 
Difference. . os... ea: Se fee 22° 2 1.8 
ee 80.9 73.1 65.0 507 406 272 218 
Difference. . 38 ¢3: 2a. 7a: tos 50 2.4 
Complete .... 84.7 824 75.0 586 50.7 32.2 24.2 
Total D.... 23 247 2S me ws 9.3 4.2 
100% learning 
2 a 71.1 64.4 30.4 26.3 22.9 
Difference. . 9.4 89 9.0 5.7 3.0 
UR adsee 80.5 73.3 48.4 32.0 25.9 
Difference. . a6: 36 5.8 Ss) 28 
Complete .... 83.4 77.2 54.2 35.0 28.1 
Total D.... 12.3 128 14.8 8.7 5.2 
67% learning 
corre 65.1 42.0 36.4 26.1 17.2 
Difference... 128 12.5 13.6 25. a 
FF (ae 77.90 54.5 50.0 31.3. 19.7 
Difference. . 26 9.6 7.4 2.2 . 
Complete .... 80.5 64.1 57.4 33-5 20.0 
Total D... 15.4 22.1 21.0 76° Om 
33% learning 
© OR kadai oes 53-3 37.7 26.2 17.7 9.5 
Difference. . 6.1 5.7 6.8 3.6 2 
| Ge 50.4 43.4 33.0 21.3 9.7 
Difference. . 1.3 4.2 2.2 2 8 
Complete .... 60.7 47.6 35.2 21.5 105 
Total D.... 2h 9.0 3.8 1.0 


where the retention values for the 150% learning curve decrease 
very rapidly, as noticed in the last chapter. The facts still await 
an explanation, but we shall have to postpone further discussion 
to the end of Ch. V. 

With increase in the length of the time interval, the same de- 
cline in the effect of extending the time limit is also observed. 
Previous to the lapse of the 4-hr. interval, the increment due to 
extending the time limit grows larger and larger. It then sud- 
denly decreases with time. This characteristic change of the in- 
crement prevails under various conditions. It holds for all de- 
grees of learning. It is not altered by scoring position and se- 
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TABLE XX 


RECOGNITION, COMPARISON OF PRELIMINARY AND FINAL REcoRDS 
20min. th 2h 3h. 4h 6h. iI2h. day 2days 


150% learning 


Oy SOR. cs. 06.7 94.1 or o1.5 887 858 728 
Complete .... 97-55 958 93.3 91.6 925 832 728 
Difference. . 8 1.7 2.2 E 38 —2.6 Ke) 
100% learning 
re 95-7 938 Q1.5 71.2 60.4 
Complete .... 968 948 92.7 76.1 75.2 
Difference. . I.I 1.0 1.2 4.9 5.8 
67% learning 
er 92.9 94.6 85.2 726 61.5 
Complete .... 93.2 93.3 84.7 73.7 61.5 
Difference. . 3 —I.3 as 1.1 x) 
33% learning 
ORME. cccess 75.0 66.0 54.3 446 20.4 
Complete .... 73.3 64.4 54.6 45-7. 25.5 
Difference.. —1.7 —1.6 3 ILI —3.9 


quence, nor is it minimized when the increment is computed as 
a percentage of the total score. 

The strength of retention for the different syllables is, there- 
fore, not equal, Some are more easily recalled than others, and 
consequently take less time. When the time interval is length- 
ened, the more difficult and uncertain ones deteriorate first. The 
amount of this partial retention increases in value for the first 
few hours after learning. Thereafter, not only does retention 
as a whole deteriorate with time, but the strength and the amount 
of partial retention also decrease so that its re-instatement upon 
the extension of the time limit becomes less and less probable. 
The assumption as presented in Ch. II which states that the 
amount of partial retention increases with the time interval for 
all memory processes is evidently unsound. 

We can mention the fact in this connection that from 4 hours 
to I day is a long interval, and that in the latter case, sleep occurs 
between learning and relearning. Increase in the degree of the 
original learning seems to arrest this change in the magnitude of 
the increment, though very ineffectively. Thus, with 150% 
learning there seems to be a plateau in the effect of extending 
the time limit for the intervals from 3 to 12 hours inclusive, and 


THE CONDITIONS OF RETENTION 59 


then the sudden decrease. This would mean that the growth of 
the total amount of forgetting is arrested to that extent. In 
100%, 67% and 33% learning, the abruptness of that change 
which occurs at the lapse of the 4-hr. interval to the increment 
resulting from longer durations of the recalling process is also 
somewhat proportional to the degree of the original learning. 


2. Comparison of the Recognition Results. 

Coming now to recognition, the effect of extending the time 
limit beyond go sec. is quite different from the results we just 
discussed. In some respects, the conclusions from these two 
methods of measurement are contradictory. If we can directly 
compare the magnitude of the scores, the increment for recogni- 
tion is very much smaller. But a more significant contrast is that, 
with 100% learning, the increment for recognition is almost con- 
stant in value until the lapse of the 4-hr. interval, and then sud- 
denly increases for the 1-day interval and becomes still higher 
at the end of 2 days. This contradicts what we have found in 
written reproduction in every particular. Assuming that partial 
retention takes more time for recall, as we have done, these char- 
acteristics of the recognition process seem to corroborate 
Strong’s’ conclusion which maintains that in recognition memory 
the amount of partial recognitions does not decrease in time as 
fast as the amount of recognition as a whole. One may even 
conclude that the partial recognitions actually increase with the 
length of the interval. 

With 150% learning there seems to be a general increase of 
the effect of extending the time limit upon the amount of recog- 
nition until the lapse of the 12-hr. interval. At that point the 
increment disappears. The subjects seemed to have selected all 
the syllables they could recognize at the end of 90 sec., the rest of 
the process being chance performance. It is difficult to think of 
an increase of 50% in the orig'nal learning as affecting a de- 
crease in the amount of recognition. A tentative explanation of 
this fact will be presented at the end of Ch. V. 

For 67% and 33% learning, there is no sudden change of 


2 Op. Cit., pp. 352 ff. 
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the increment as with 150% Extending the time limit for recog- 
nition does not result in any appreciable change in the numerical 
values either way, except that at the end of the 2-day interval for 
33% learning, it affects a considerable decrease in the total score. 
This is to be expected if we remember that finally the amount of 
partial recognition may itself decrease so that even the presenta- 
i tion of the original material does not avail. Nevertheless, the 
: subject was required to complete the selection of 12 syllables, de- 
pending upon chance; hence, there was a decrease in the total 
score. This final decrease in the amount of partial recognition 
is also hastened by a less complete degree of learning. Thus, 
| while the numerical value for the 2-day interval with 67% learn- 
? ing is not changed by the extension of the time limit for recall, 
4 the corresponding score was decreased by 3.9 with 33% learning. 


SRE 1 eS SSPE Shoe” SSSR NI a AFP SF 


3. The Gradation of the Memory Processes. 

The results from both methods of measurement seem to in- 
dicate that written reproduction and recognition memory are 
quite different, but the difference is still one of degree, not of 
kind. One process may pass over to the other. Judging from 
commonsense, recognition memory lasts longer than the ability 
to reproduce ad verbatim. What fails even the vaguest recall 
may, upon the presentation of, the object, flash into distinct recog- 
nition. On the other hand, if enough time be allowed, one can 
as a rule recognize what he can recall. It seems that the memory 
processes are graded in some such way as the following: 

A. Complete retention. 

B. Partial retention, which takes time for recall, and may 
involve errors, as will be seen in another chapter. 

C. Still less permanent retention which may completely 
escape written reproduction, but which, nevertheless, 
may be reinstated in recognition. 

D. Partial recognition memory which can be developed upon 
extending the time limit for recall. 

E. Retention that cannot be measured even by the method 
of recognition. It approaches complete obliviscence 
and occurs at the end of a fairly long interval after 
incomplete learning. 
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Condition A gives place to B soon after learning, at least with 
a great part of the retained material. Thereafter B approaches C 
faster than A does B so that the total amount of B decreases 
with the lapse of the 4-hr. interval. C lasts for a long time and 
gives place to D. D is not effective upon the immediate presenta- 
tion of the original material, but may return in the process of 
recognition. When the degree of the original learning is only 
33%, the amount of D becomes insignificant at the end of 2 
days. The paradoxical effect is to shorten the duration of the 
actual process of recognition to less than go sec. when the syl- 
lables that can be recognized have all been selected, but ap- 
parently to increase the duration beyond that time limit. Nothing 
being remembered, the extended time serves only to fulfill the 
requirement of the experiment, which is to select 12 syllables. 


4. The Effect of Extending the Time Limit upon the Shape of 
the Curves of Retention. 

(1) In written reproduction the curve changes with the mag- 
nitude of the increment resulting from extending the time limit 
to 5 min. As compared with the preliminary curve for the 1- or 
2-min. records, the final curve falls more gradually within the 
first four hours after learning, and then more suddenly. If the 
preliminary curve of forgetting be logarithmic, the effect of the 
increment would at least tend to complicate the function. 

(2) In recognition with 67% learning, the more gradual fall 
of the curve owing to the extension of the time limit continues 
until the end of the second day. 

(3) In recognition with 67% and 33% learning, extending the 
time limit does not bring about any appreciable change in the 
curves. 

(4) The shapes of the curves are practically determined for 


written reproduction at the end of 2 min. and for recognition at 
the end of 90 sec. 
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V. THE RELATION BETWEEN THE AMOUNT OF 
ERROR AND OTHER FACTORS 


In the recognition and reconstruction methods of measurement, 
the score was determined directly by the amount of error made 
in recall as well as by the amount of correct material. With the 
“saving method” the number of presentations required for re- 
learning was determined by the amount of forgetting, but inci- 
dentally also by the amount of error. But errors were disre- 
garded in the scores for anticipation and written reproduction. 
An attempt to keep separate records for the number of incorrect 
responses in anticipation met with failure. The duration of 
recall for each syllable was too short, considering the fact that 
the experimenter already had to turn the drum and to record 
success or failure between responses. In written reproduction, 
however, the records were permanent and we could study the 
amount and nature of error after the experiments were com- 
pleted. | 


I. The Amount of Error as a Function of the Length of the 
Interval. | 

The amount of error made in written reproduction for each 
time interval and each degree of learning is presented in Table 
XXI. With the possible exception of 33% learning, the amount 
of error increases with the length of the interval. 


TABLE XXI 
AMOUNT OF Error IN WRITTEN REPRODUCTION 
20min. thr. 2hrs. 3hrs. 4hrs. 6hrs. i2hrs. 1d. 2d. 


150% learning... “706 gt Oo OS OS ee ee 
I ies Nain hae 4.2 5.8 11.7 11.7 8611.3 
DE aceweRuses « 43 <« 5.4 7.7 9.0 
BOE i ivekedce 44 7.9 10.8 52 87 


2. The Relation between the Amount of Error and the Degree 
of Learning. 
In Table XXI the amount of error for 150% learning is prob- 


ably smaller than for any other degree of learning with the 
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shorter intervals, but it grows to be the largest when the interval 
is lengthened. 

On the whole, error does not seem to be proportional to the 
degree of learning until the lapse of the 4-hr. interval. There- 
after the gross amount of error increases with the degree of 
learning. 

These facts may be compared with the effect of extending the 
time limit upon the amount of reproduction, as discussed in Ch. 
IV. The magnitude of that effect for 150% learning changes 
from the shorter to the longer intervals in the same manner as 
does the amount of error. Before the lapse of the 4-hr. interval 
also, that effect is not proportional to the degree of learning, but 
the two factors take on a functional relationship for the 1-day 
and 2-day intervals. So the relationship between learning and 
error is similar to the relationship between learning and the 
effect of extending the time limit. However, the latter effect 
decreases with the lapse of the 4-hr. interval, while the amount 
of error increases with the time interval to the end of 2 days. 

As already explained, the effect of extending the time limit is a 
function of the amount of partial retention. It is proportional 
to the amount of retention of condition B (p. 60) which can be 
reinstated in written reproduction but which takes time. Now we 
are ready to state a theory as to the significance of error making, 
and to see how it can be applied to explain the facts enumerated. 
The condition of error making is not complete forgetting or ob- 
liviscence. Jt is the presence of partial retention which can 
hardly be reinstated but which, nevertheless, is so near the point 
of complete recall as to cause conflict and confusion. Errors are 
made mostly in the change from condition B to C. 

Thus, with 150% learning, on account of the higher degree of 
original mastery, the amount of partial retention of condition 
B is small as compared with that of A. The amount that is due 
to the change from condition B to C is also insignificant. Hence, 
we have the smaller amount of error for the short intervals. 
When the time interval is lengthened, condition B prevails and 
the amount of error increases steadily. 
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Similarly, we can explain why the amount of error is parallel 
to the effect of extending the time limit in almost every instance. 
The two are reciprocal functions and both are due to the exist- 
ence of partial retention. Eventually the amount of error will 
decrease with the amount of partial retention, but the former 
may keep on increasing while the effect of extending the time limit 
has reached a climax. The amount of error increases because 
condition B approaches C much nearer for the longer intervals 
than for the shorter ones. Therefore, the increase in score due 
to extending the time limit, plus the amount of error, is an ap- 
proximation of the amount of partial retention. The change 
from condition B to C is a very complicated process. 


3. The Relation between the Amount of Error and the Amount 
of Retention. 

When the time interval is lengthened, retention decreases but 
error increases. So if the amount of error is calculated as a. per- 
centage of the amount of retention, the values will increase more 
rapidly. The significance of this comparison is questionable. 
The amount of error should rather be compared with the amount 
of forgetting, the whole syllable series minus the amount of re- 
tention, which therefore increases with the time interval. 


4. The Relation between the Amount of Error and the Amount 
of Forgetting. 

The comparative data for the amount of forgetting and of 
error are presented in Table XXII. 

The increase with the time interval in the amount of error is 
much slower relative to the increase in the amount of forgetting. 
This difference in the rate of increase with the time interval is 
further inversely proportional to the degree of learning. 

As already stated, errors are made mostly in the transition from 
condition B to C, and the partial retention that cannot be even 
thus reinstated is apparently forgotten, according to the written 
reproduction method of measurement. So with the increase in 
the time interval, the amount of forgetting has a higher accumu- 
lative value than is possible to the amount of error. The former 
naturally increases more rapidly. Further, if a higher degree of 
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TABLE XXII 


CoMPARISON OF THE AMOUNT OF FORGETTING AND OF Error IN 
WRITTEN REPRODUCTION 


‘ Dm th se 2s ae OB 20m. 28 26 
150% learning 
Forgetting .... 120 15.6 181 344 45.6 61.5 69.2 
| 2.7 3.1 6.7 7.3 8.3 128 15.8 
1co% learning 
Forgetting .... 94 142 35.2 544 598 
BE Siveecie ws 4.2 5.8 11.7 uy - 138 
67% learning 
Forgetting .... 14.6 27.5 34.2 58.5 75.2 
BE bsewe con 3.3 4.6 5-4 7.7 9.0 
33% learning 
Forgetting .... 32.3 46.0 57.3 73.8 86.3 
EE it. 2a 10.8 a9. ..8¢ 


learning tends to arrest the whole process of forgetting, then the 
difference between the increase in the amount of forgetting and 
of error will be inversely proportional to the degree of learning. 

Aside from these general statements, the relationship between 
error and forgetting is obscure. With 150% learning, the 
amount of forgetting is to the amount or error as 5 is to I, for 
all the time intervals. This ratio regularly decreases with the 
time interval when the degree of learning is reduced to 67%. 
With the other degrees of learning, there is no definite relation- 
ship. The P.E.’s of the values that constitute the curve for 
the amount of error are too high to give warrant to further 
generalization. 

However, this lack of similarity or causal relationship be- 
tween the two-.groups of values only intensifies the problem. The 
amount of error is indicative of the amount of partial retention. 
In other words, the curve for the amount of error is a part and 
parcel of the curve of forgetting. Upon the evaluation of this. 
relationship will depend whether a universal mathematical state- 
ment of the problem is possible. 


THE EFFECTS OF 150% LEARNING UPON Various Factors 


From the above section, it is found that the relationship be- 
tween forgetting and error is more definite for 150% than for 
any other degree of learning. The ratio of the two amounts does 
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not decrease with the time interval as it does with lower degrees 
of learning. We are now ready to gather together what has 
been noticed in the last two chapters concerning the character- 
istics of 150% learning. 

1) Its retention values are lower than for 100% learning at 
the end of 1 and 2 days in written reproduction, at the end of 
I day in reconstruction and at the end of 2 days in recognition 
(p. 50). 

2) The effect of extending the time limit upon the amount of 
written reproduction is peculiar in this case. A second extension 
of the time limit from 2 to 5 min. brings about a larger incre- 
ment than the first extension from I to 2 min. This relative 
effectiveness of the two extensions of the time limit is just the 
reverse of what has been found with all other degrees of learn- 
ing (p. 56). 

3) Extending the time limit for recognition gives negative 
results at the end of the 1- and 2-day intervals. The effect of 
the extension is different for the shorter intervals with the same 
degree of learning and for all the intervals with 100% learning 
(p. 59). 

An explanation for these peculiarities is possible under the fol- 
lowing suppositions. | 

A) A high degree of learning, as we have indicated, tends to 
arrest the process of forgetting. In the process of forgetting, re- 
tention of condition A approaches partial retention of condition 
B, the latter approaches C, etc. 

B) Most of the syllable series for 100% learning were given 
each subject before the 150% series. In the former experiments 
they had noticed that the amount of retention after I or 2 days 
was comparatively low. This fact might have influenced their 
attitude when they came to the longer intervals in 150% learning. 

Combining these two postulates, it seems probable that for 
the longer intervals there may be a conflict of condition B with 
both A and C, when B is intensified with over-learning. The 
retroactive effect is (1) to decrease the total amount of written 
reproduction. (2) It naturally follows that the effect of the 
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second extension of the time limit will be greater than that of 
the first, for the conflict will tend to prolong the recall process of 
even the well retained members. (3) And as condition B always 
approaches C and also conflicts with C, the amount of error will 
be increased for the longer intervals. 

Even on this hypothetical basis, there is no explanation for 
the sudden drop of the retention curve for recognition at the end 
of 2 days. In the same connection the extension of the time 
limit gives negative results. Probably, over-learning causes a 
part of the syllable series to stand out more distinctly, thus con- 
trasting with the relative “amnesia” of the other parts. 

Were these explanations unsatisfactory, the fact remains con- 
clusive that over-learning to the extent of 150% is at less ad- 


vantage than 100% learning when tested for retention at the end 
of 1 and 2 days. 
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VI. THE DURATION AND THE SPEED OF THE 
PROCESS OF RECALL IN WRITTEN REPRODUC- 
TION, RECOGNITION AND RECONSTRUCTION 


Two scores, one of amount and one of time, are not mutually 
interpretative, but the latter may in a way be indicative of the 
nature and the strength of retention, though not in quantitative 
terms. The data thus far presented all concern the amount of 
retention, correctly or incorrectly reproduced. In Ch. IV we dis- 
cussed the effect of different time limits only in relation to the 
amount of reproduced material. We can now consider the dura- 
tion and the speed of the process of recall with the different 
methods of measurement. 

The “saving method” does not give separate measurements for 
time and amount, so the two cannot be independently treated. 
The duration or the speed of the anticipation process is not sig- 
nificant, its value being a constant, 2 sec. for each syllable. 

With the other three methods of measurement, duration and 
speed are quite independent of the amount of retention. In 
written reproduction the subject could take any length of time 
up to 5 min. As a rule, he did not take as long as 5 min. to 
finish the process. In recognition and reconstruction, there was 
not even a time limit. So the relationship between the time and 
the amount of recall becomes an important problem. 


1. Duration as a Function of the Order in which the Measure- 
ments were Taken. 

In Table XXIII are presented the average durations of the 
three processes of recall in number of seconds. 

From Table XXIII, written reproduction had the longest dura- 
tion, recognition the second and reconstruction the last. That 
was exactly the order in which the measurements were taken, 
written reproduction being the first, recognition the second and 
reconstruction the last. 

68 
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TABLE XXIII 


DuraTION oF RECALL, No. oF SEC. 
Su 1h sh sh sh Gh wh 1 26 


Writ. Reprod. 
150% learning 134.4 171.4 1938 209.5 108.6 186.4 178.7 
*100% A...... 112.2 134.0 147.9 132.1 97.0 
100% B...... 145.5 171.2 211.6 182.7 176.0 
SE eseees 139.0 207.4 189.3 157.5 154.6 
SP wh wg 108.8 155.1 124.2 108.3 101.4 
Recognition 
150% learning 60.6 71.7 818 943 99.9 86.9 1142 
*100% A...... 76.7. 87.1 108.1 126.9 1328 
100% B...... 726 78.4 92.6 89.9 101.3 
Ge. eeasee 68.9 83.2 98.9 92.7 107.9 
ME. cad s'oe 88.4 104.0 100.6 93.1 114.0 
Reconstruction 
150% learning | 20.55 323 410 502 51.1 61.4 602 
*100% A...... 47.9 41.9 50.4 62.3 687 
100% B...... 50.0 41.1 45.3 57.9 59.2 
an 37-5 53.2 48.2 58.0 578 
re 43-7 44.5 52.3 48.1 51.7 


*A The first series of experiments. 

B_ The second series of experiments. 

The duration of written reproduction was shorter in the 
first series of experiments than in the second series, but the com- 
parative duration of recognition was vice versa. No important 
difference between the two series of experiments was recorded 
in reconstruction. 

So the difference in duration may have incidentally resulted 
from the technique of the experiments, quite independent of the 
relative difficulty of the processes. Each recall process may have 
facilitated the succeeding one. The longer the written reproduc- 
tion process, for instance, the shorter was the duration of recog- 
nition. However, as we have seen in Ch. II, the conditions of 
recall differed in the number of restricting factors involved. 


Most probably, these factors also influenced the duration of the 
processes. 


2. The Speed of Recall. 


The recognition and reconstruction methods of measurement 
required the subject to complete the process of recall regardless 
of the amount of correct retention. So with these two methods, 
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the duration and the speed of recall are identical. The condi- 
tions were very different in written reproduction. There the 
subject could “give up” at any time. The averages presented in 
Table XXIII fall far below the limit of 5 min. The average 
subject would “give up” long before the lapse of that time limit. 
At the same time, the amount of reproduction varied with the 
amount of retention, and the differences in duration might simply 
be in part a function of the amount of material that was repro- 
duced. 

To avoid this difficulty, the speed of written reproduction is 
calculated as the number of seconds per unit material. If the dura- 
tion of recall varied only as an effect of the amount of reproduc- 
tion, then the speed per unit would have a constant value for all 
the intervals. Such, however, is not the case, as may be seen in 
Table XXIV. 


TABLE XXIV 


SPEED OF Repropuction, No. or Sec. PER Unit MATERIAL 
com rth oh. gh eh Om Oe. 28: OS 


150% learning 1906C aC tC(‘( aK OB CUKDCC 
SP decane 1.7 I.1 \ 3.8 6.0 7.3 
| AT ae 1.8 3.5 : 4.4 6.3 9.3 
Os apis. 8 ge : 3.6 os sks 


Comparing that table with the recognition and reconstruction 
values in Table XXIII (except the data from the Ist series of 
experiments), the relationship between the speed of recall and 
other factors may be summarized as follows: 

(1) The speed of recall decreases with the time interval. 
This generalization holds for written reproduction without ex- 
ception. That such a tendency exists in recognition is also un- 
questionable. With reconstruction, the difference in speed be- 
tween the 1-day and 2-day intervals is very slight, and there are 
also marked deviations from the assumed functional relation- 
ship for the shorter intervals. But the decrease in speed with 
time may be clearly seen if we taken the average of all the de- 
grees of learning. 

(2) On the whole, the speed of recall increases with the degree 
of learning. 

(3) Since the duration of recognition and reconstruction in- 
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creases with the time interval, while the amount retained and the 
accuracy of the two processes decrease with time, it follows 
that speed increases with accuracy. The increase in speed with 


respect to accuracy is much faster than the increase with respect 
to the time interval. 


3. Comparison between the Speed of Recall and the Amount 
of Forgetting. 

The increase with the time interval in the number of seconds 
per unit recall, as further complicated by the degree of learning, 
may be compared with the amount of forgetting which also in- 
creases with time and varies with the degree of learning. The 
data are gathered together in Table XXV. It is useless to com- 
pare the absolute amount of forgetting with the total speed of 
the process, since only in the light of the general shape of the 
curves can such a comparison be intelligible. The values pre- 
sented in Table XXV are converted from the original data, using 
the numerical value obtained from the shortest interval in each 
case as the unit. The table reveals especially the relative increase 
in the values with the length of the time interval. 

In spite of the arbitrary process in reducing the amount of for- 
getting and the speed of recall to the same unitary basis, any 
graphical representation of the data in Table XXV would still 
be so complicated as to make interpretation impossible. The 
curves of forgetting may be said to be logarithmic in a sense, 
but a similar mathematical statement would no longer hold for 
the curves for the speed of recall. A possible generalization one 
can make from these facts is that the curves of speed do not 
rise as rapidly as the curves of forgetting. The decrease in the 
speed of recall with respect to the length of the time interval is not 
as rapid as the decreases in the total amount of retention. 

So the amount of forgetting and the speed of recall do not 
have the same type of curves. The results of this section agree 
with the conclusion reached in Ch. II concerning the difference 
between the relearning and the other methods, only we have at- 
tained the additional observation that the time curves differ 
among themselves even more radically than do the curves of for- 
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TABLE XXV 
CoMPARISON OF THE AMOUNT OF FORGETTING WITH THE SPEED OF 
RECALL, TAKING THE NUMERICAL VALUE OF THE 
SHortTest INTERVAL AS UNIT 


ana, thn ch 2& 6e& Gh .c8h .6¢ 
Writ. Reprod. 


150% learning 


Forgetting. . 1.00 1.30 151 287 380 5.12 

Speed ...... tao 120 «(«1137«¢«( 8S 6853) (Oat 
100% learning 

Forgetting.. 1.00 1.51 3.74 5.78 

eee 1.00 1.24 2.24 3-53 
67% learning 

Forgetting... 1.00 1.88 2.34 4.01 

Speed ...... 1.00 1.04 2.44 3.50 
33% learning 

Forgetting... 1.00 1.42 1.77 2.28 

Speed ...... 1.00 1.78 2.00 3.39 

Recognition 

150% learning 

Forgetting. . 1.00 .63 74 $1.70 1.50 4.53 

Speed ...... oo. 82 125 6 6 Ute 
100% learning 

Forgetting.. 1.00 .gO 2.35 4.80 

ae 1.00 108 — 1.28 1.24 
67% learning 

Forgetting... 1.00 2.76 4.59 5.42 

Speed ...... 1.00 1.21 1.44 1.35 
33% learning | 

Forgetting.. 1.00 1.56 2.13 3.03 

Speed ...... 1.00 1.18 1.14 1.05 

Reconstruction 

150% learning 

Forgetting. . 100 1.68 268 3.28 3.00 6.72 

ee 1.00 1.37 1.30 1.70 1.73 2.08 
100% learning 

Forgetting.. 1.00 L.19 2.00 5.33 

Speed ...... 1.00 82 QI 1.16 
67% learning 

Forgetting... 1.00 99 2.25 3.87 

Speed ...... 1.00 1.42 1.29 1.57 
33% learning 

Forgetting— 1.00 1.33 1.70 2.03 

Speed ...... 1.00 1.02 1.30 1.10 


2d. 


5:77 
4-53 


6.36 


5-15 
5-17 


2.67 
6.17 


4-49 
1.88 


5-23 
1.40 


8.52 
1.57 


3.28 
1.29 


10.88 
2.04 


5.02 
1.18 


5.66 
1.57 


2.79 
1.18 


getting. If the relearning method could be varied and controlled 
as are the other methods, the amount of “saving” would most 
probably increase or decrease according to various conditions 











Vil. INDIVIDUAL DIFFERENCES AND 
CORRELATIONS 


I. Indwidual Differences in Practice Effect. 


It has been sometimes maintained that the practice effect in 
learning nonsense material disappears after the successive mas- 
tery of but a few series. In our experiments we had the oppor- 
tunity to plot the practice curve for each individual subject. 
About one-half of the subjects learned more than 50 series each, 
thus giving rather extensive practice curves. From the com- 
parison of these curves, it seems that the extent of practice effect 
is subject to individual differences. For most of the subjects 
it is present even after the mastery of 40 or 50 series, and it de- 
creases with different rates for different individuals: Three 
typical curves are given in Fig. XI (Smoothed). 

















at 


Generally speaking, the practice effect in these curves seems to 
have disappeared after the tenth trial, but individual differences 
are, nevertheless, present. The curve for subject Y has an abrupt 
initial drop which is not so prominent in the other curves. That 
is, he adapted himself to the situation more quickly than did 
the other subjects. The readiness with which one adapts to this 
particular situation is in a way proportional to his speed 
of learning. After the tenth trial the gradual fall of the curves 
for Le and Y is noticeable to the very end, but the curve for Lo 
is stationary. So individuals differ not only in the amount of the 
initial drop, but also in the gradual decline of the practice effect. 
A break occurred in the curve for Y when for more than two 
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months the subject did not work on nonsense material. The 
practice effect was carried over that interval. 

In Ch. III it was mentioned that the subjects could use 67% 
of the average number of presentations to a greater advantage 
after they had practiced in 150% and 100% learning for more 
than 5 weeks. This improvement in learning also varied greatly 
according to the individual. As previously stated, we took an 
average of the number of presentations required by each indi- 
vidual for the mastery of the 20 syllable series in 100% and 
150% learning. The number of series that we learned with 
only two-thirds or less of the average number of presentations, 
as determined for each individual, was exceedingly small. How- 
ever, when they came to 67% learning, most of the subjects 
learned one or more of the series with that number of presenta- 
tions. Table XX VI shows how the individuals differ in this 
respect. 


TABLE XXVI 


Series LEARNED WITH 2/3 oR LESS OF THE AVERAGE 
NUMBER OF PRESENTATIONS 


In the first 20-25 series In the next 10 
SUBJECT | 
B 
I 
Ka 
Ko 
Lud 
Luh 
S 
Wi 
Wo 
Y 


2. Individual Differences in the Speed of Learning. 


Table XX VII presents the average number of presentations 
required by each subject to learn a series of 12 nonsense syllables. 
It takes an average subject about 14 presentations to learn 
a series of 12 nonsense syllables by the anticipation method. This 
average is just a little higher than that given by Finkenbinder.’ 
The two groups are about equal in efficiency, for as already 
1 Op. cit., pp. 21-22. 
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TABLE XXVII 
AvERAGE NUMBER OF PRESENTATIONS For EacH SERIES 


SUBJECT NO. OF PRESENTATIONS P.E. NO, OF SERIES LEARNED 
*Luh 4.95 .20 20 
*y 6.42 18 40 

Ko 6.85 .26 20 
*] 8.75 33 20 
*Wa 9.42 .27 50 
*Le 9.84 21 50 
*C 10.90 55 20 

R 11.88 .32 50 

DW 13.26 .37 50 

Lo 13.50 28 50 

Lud 13.65 33 20 

Ka 16.20 57 20 
*s 16.50 62 20 

Wi 17.20 37 20 
*Ts 18.10 54 20 

B 18.60 51 20 

Kan 19.75 86 20 

Wo 19.80 65 20 
*F 24.50 67 20 

Av. 13.69 


*Chinese students. 
indicated, it is more difficult to spell a syllable letter by letter 
as required in our experiments than to pronounce it as a whole 
as required by Finkenbinder. A group of 15 to 20 subjects is, 
therefore, large enough to make a random sample. 

The fastest learner of the group is five times as proficient as 
the slowest learner. On the whole, the Chinese students are bet- 
ter memorizers than the Americans. The averages stand as 12.15 
against 15.07. With the exception of subject F, the difference 
would be much higher. Six Chinese occupy the first seven places. 
This superiority of the memorizing ability of the Chinese is 
interesting in connection with the problems of classical training 
and the improvement of memory with practice. 


3. Individual Variability in the Amount of Retention. 


100 S. D. 
Applying the formula V = 





, we calculated the 


Mean 
coefficient of variability of the average amount of retention for 
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the five methods of measurement and the four degrees of learn- 
ing. These coefficients are tabulated in Table XXVIII. 


XXVIII 
COEFFICIENTS OF VARIABILITY 
gm. th Bh ch ok Ch. . coh... 46 96 


Anticipation.... 26.2 289 41.0 80.9 133.3 
Relearning ..... 1 318 22.6 31.3 34.3 
Writ. Reprod. 
150% learning ws. .175 165. Mae 231 -74::- 
OEE cas dius 68 11.7 27.0 56.8 70.4 
PUD chsewses 66 28.5 31.2 48.1 106.7 
ER Shek to us 178 32.0 38.5 86.4 115.5 
Recogmtion ' 
150% learning 34 44 66 90 15.2 185 189 
SE sashes 4.3 5.8 78 22.9 20.9 
a she ess 11.3 86 13.2 256 318 
MT e's 5 kee 19.3 16.6 41.6 62.9 66.5 
Reconstruction 
150% learning 156 122 98 148 238 539 698 
SOE oiesescs 10.3 12.7 17.0 40.3 57.0 
ee Sik easae a7 3213 23.8 28.7 70.3 
BOD ccssaves 24. 323 41.4 85.5 784 


The magnitude of the coefficients of variability for the long 
intervals indicate that the data are not statistically reliable. 
However, our present problem is exactly to describe, if not to 
interpret, the differences in statistical reliability, or individual 
variability, under certain conditions. So the above statement 
directly leads to the following generalization. 

(1) Individual variability increases with the time interval. 
This factual statement holds for all the methods of measure- 
ment and all degrees of learning. The tendency can be more dis- 
tinctly observed as graphically represented in Fig. XII, for 100% 
learning. 

These graphs are based on similar, and in some cases the same 
numerical values as are the retention curves in Fig. II. A com- 
parison of the figures brings out the fact that the curves for the 
coefficients of variability have not only preserved the particular 
order of the different methods of measurement, a proportionality 
of the absolute differences in numerical value, but to some extent, 
even the specific similarity or dissimilarity in general shape; 
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they also manifest that characteristic difference between relearn- 
ing and the other methods of measurement. The relearning 
curve begins as the second in height in the order of variability 
but ends as the fourth, having crossed the written reproduction 
and reconstruction curves and now stands half way between 
recognition and reconstruction both in shape and numerical 
value. The significance of this comparison has been discussed 
at length in Ch. II, where it was pointed out that relearning is 
not a helpful method for the study of individual differences. 

In the present connection, the coefficients of variability for 
the different intervals as determined by the relearning method 
fall within a close range in numerical value. Just as the retention 
curve for relearning is complicated by involving two learning 
curves for memory, so also the corresponding curve for the co- 
efficients of variability becomes almost unanalyzable because of 
the same complicaion. In Fig. XII the asterisk represents the 
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coefficient of variability for the original learning, which is 37.8. 
The implications of the “saving method” would lead one to 
expect that this value would be rather close to the average value 
of the relearning curve in the same figure. 

(2) Individual variability increases inversely as the degree of 
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learning. Exceptions are found in written reproduction and re- 
construction with 150% learning at the end of the 1-day and 
2-day intervals. The explanation given in Ch. V for the char- 
acteristics of 150% learning will cover the present instances. 

That the increase in the degree of learning should tend to 
equalize and finally to eliminate individual differences is also to 
be expected. For a certain degree of over-learning will make 
the material so well fixed for any individual who can fulfill the 
requirements of these experiments that the amount of retention 
will be always 100%. Such are our habitual and conventional- 
ized reactions as we so often observe in daily life. The varia- 
bility of these reactions approximates o. In other words, the 
effect of increasing the degree of learning upon the coefficient 
of variability approaches o as a limit. 

As a corollary to the above conclusion, the phenomenon of 
diminished returns may be described more specifically. Since 
the increase in the degree of learning brings about diminished 
returns in the amount of retention and at the same time neutral- 
izes individual variability, it follows that, in the long run, an 
individual very efficient in immediate retention is not likely to 
improve with over-learning as rapidly as another who is very in- 
efficient in immediate retention. 

(3) Individual variability ‘also seems to be a function of the 
method of measurement and to increase unth the number of re- 
stricting factors involved in the recall process, as explained in 
Ch. II. 78 

(4) Summarizing (1), (2) and (3), individual variability im 
retention increases with the difficulty of the act and deareases 
with the frequency and the recency of practice. 

4. Correlation between the Speed of Learning and the Amount 
of Retention. 

The formula used is 

62D? 


~ N(N?—1) 


and P. E. = .703 TN Table XXIX gives the correlations 





p==l Then r = 2 sin (=) 
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whose numerical values are at least twice as large as their re- 
spective P. E.’s. 


TABLE XXIX 
CoRRELATION BETWEEN THE SPEED OF LEARNING AND THE 
AMOUNT OF RETENTION 


om th sh skh 4h 6h. 1m - 3G:..: 96 
Relearning ..... —.42 —.42 
ah See 7 18 18 
Anticipation .... 51 
a 18 
Writ. Reprod. 
150% learning 43 
ak en 18 
a 30 .40 
= ere 15 14 


EE ha an ea .40 
yf ae 19 


Recogmtion 
150% learning 59 53 —.47 —.64 
| ae 14 .16 17 13 
100% learning . fk .37 
ty ae 14 15 14 
67% learning 42 —.40 —.57 
MMs ddsace 18 ae 


Reconstruction 
150% learning .50 44 
ae 17 18 


67% learning .58 —.47 
Be iiiewée sc 15 .17 
33% learning 4I 

oS eae 19 


The correlation values are all positive except two in relearning, 
four in recognition and one in reconstruction, and the chances are 
at least 4.5 to 1 that the data will be reproduced in another series 
of experiments with as few as ten subjects. 

The negative correlation between learning ability and the 
amount of retention as measured by the “saving method” is an 
obvious consequence of the method of computation. Let X and 
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Y represent the number of presentations involved in learning and 
ae 

relearning respectively. Then X and “ will represent deficiency 


X—Y 
and proficiency of learning ability respectively, and x or 





[= = will represent the percentage value of retention as 
measured by the “saving method,” in which the fraction x will 
. . Cc 
have a value less than 1. The negative correlation between x and 
I — < which we secured means a positive correlation between 
X and 1 — . and this is necessarily due to a negative correlation 
between X and ‘ for as X increases, the value of 1 — — can 
increase only as the value of the fraction a decreases. 


This negative correlation between X and > will naturally 


occur because of the presence of X in both values whenever the 
following relations between X and Y obtain: . 
1. Absence of correlation. 
2. A negative correlation. 
increment Y 








3. A positive correlation when 7 is less than 
increment X 
xX 
; Cc bd 
In other words, the correlation between 7 and 1 — — is neces- 


sarily negative unless X and Y are positively correlated and at 
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increment Y . 
the same time fulfill the condition that 7 is equal to 





increment X 
or greater than 





The actual correlation between X and Y determined in these 
experiments is positive, as presented in Table XXX. The re- 
quired relation between the increments of X and Y cannot be 
determined very easily. However, considering the phenomenon 
of diminished returns in the learning curve, such a relation be- 
tween X and Y is very unlikely. There is more material to be 
mastered in the original learning than in relearning. Hence, the 
increments of X due to deficiency in learning ability will as a 
rule be proportionally as well as absolutely greater than the re- 
spective increments of Y. 

Thus, the negative correlation which we ascertained between 
learning ability and the amount of “saving”’ is a consequence of 
the fact that X is involved in both values. It is merely a product 


I 
of a negative correlation between X and —, and a positive cor- 


relation between X and Y which we secured. A negative cor- 
relation will also obtain under almost every possible relation be- 
tween X and Y. The correlation thus has no significance as to 
learning ability and retention. 

This analysis confirms our previous contentions that the re- 
learning method constitutes a poor measure of retention. 


TABLE XXX 


CORRELATION BETWEEN THE SPEED OF LEARNING 
AND OF RELEARNING 


2m th @h: 28é& .2¢4 
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With the exception of relearning, the remaining data may be 
easily summarized as follows: 

(1) With the recognition method and possibly also recon- 
struction, the correlation between the speed of learning and the 
amount of retention tends to change from positive to negative 
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as the interval is lengthened. The fast learners tend to be the 
least efficient in recognition for the comparatively longer inter- 
vals. 

(2) With the written reproduction method, the correlation 
between the same factors is always ++, if there is any correlation 
at all. The fastest learners are as a rule the best retainers. 

(1) and (2) together might suggest that the two memory 
processes differ in quality as well as in quantity, but our data are 
not conclusive. | 

(3) While the increase in the degree of learning tends to 
equalize individual differences, it does not at the outset min- 
imize the numerical value of certain correlations. On the con- 
trary, up to 150% learning, increase in learning seems to make 
the correlation between learning and retention more definite and 
reliable. 

It seems to the present writer that a more careful study of the 
correlation between the above two factors is the only systematic 
way to approach the difference between “immediate” and “per- 
manent’? memory. Sometimes it has been asserted that recall 
immediately after learning differs from delayed recall in nature 
as well as in quantity.2 One forgets that immediate recall is 
recall after a neglected interval. It is neglected because it is too 
short to be appreciable. The'control of this interval will deter- 
mine a point on the curve of retention just as any other point. 
Besides certain questionable introspective conclusions, the chief 
reason for differentiating “immediate” and “permanent” reten- 
tion in that way is the negative correlation that has occasionally 
been discovered between the speed of learning and the amount of 
retention. The relearning method was often used for this pur- 
pose and, for some unknown reason or another, one particular 
time interval was chosen. Now we have discovered that the 
numerical value of the correlation for the same group of sub- 
jects changes under various conditions. It varies with the method 
of measurement, the degree of learning, the length of the time 
interval, and perhaps with every variable condition that -we can 
mention. Similar variations will most probably be found in the 
correlation values for “permanent” memory measured for two 

2E. g., E. Meumann, “The Psychology of Learning,, Eng. Tr., pp. 40 ff. 
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different intervals. The objective reason for differentiating “im- 
mediate” and “permanent” memory is, therefore, unsound. } 
5. Correlation between the Speed of Learning and the Speed 
of Recall. 
The data are presented in Table XXXI. Like Table XXX, it 
contains only the correlation values which are at least twice as 
high as their respective P. E.’s. 


TABLE XXXI 
CoRRELATION BETWEEN THE SPEED OF LEARNING AND THE 


SPEED OF RECALL 
om th 2 s&h a GR... toh... 26. 36 


Writ. Reprod. 
150% learning 42 
3 .18 
 -f 55 61 
BE Rawesess II .10 
a aan .70 61 .40 
a II 14 19 
Rs cee 51 43 69 A9 ’ 
Sian 0.0 0:0 .16 18 Mt: 2 7 
Recognition 1 
150% learning 60 42 — 45 —.47 
8 Spee CC 18 17 
sc nenss a ae 
De Ee cecce II II 
Si iivekaws —.63 
Fs Mpsesesec 13 
RE ae en'ée 
hice + 
Reconstruction 
150% learning 71 .48 72 41 
9 II 17 II 19 
DT Recccese 36 34 
2 ae 14 .14 
i idccwses 48 —.73 
a 17 10 
SE no Shins ac 
i Se 


The speed of recall for written reproduction is taken to be the 
number of seconds per unit material. For recognition and recon- 
struction, it is the total duration of the recall process in number 
of seconds. 

Negative values are again found in recognition for the longer 
intervals. The slow learners are not only more proficient in recog- 
nition memory in the long run, but they also recognize the ma- 
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terial much faster. Another solitary negative value appears in 
reconstruction. Its significance is probably the same as for the 
negative recognition values. Otherwise, the faster learner also 
tends to be the faster in recall. This correlation is most prob- 
ably due to the fact that the faster learners are also more pro- 
ficient retainers. So we present in the next section the correla- 
tion between the amount and the speed of recall. 

6. Correlation between the Amount and the Speed of Recall. 


TABLE XXXII 
CoRRELATION BETWEEN THE AMOUNT AND THE SPEED OF RECALL 


som. th 2h. So Ga... On Oh. 364 06 
Writ. Reprod. 


150% learning _ TO Sf: Oe: CUR 61 
eS eS 6: wa — 2: 14 
WE citinstas 60 71 73 76 .50 
ee 10 3=«.: 08 07 .06 12 
yg 65 89 07 62 60 
oS 13 05 OI : 14 14 
OT i i5 ou 65 82 80 89 
ae 13 07 08 05 
Recognition 
150% learning 77 60 81 50 .44 
os re 09 «14 08 17 18 
EE 4 oases fa : 50 34 62 
=) Sper .10 13 II 14 10 
Se vais vanes 62 76 64 43 
xi Mhis cadens 14 09 13 18 
BE eiebede 38 43 
oS 19 18 
Reconstruction 
150% learning | 61 42 
J) Tee mo.)60O Je. ..8 
re 72 71 42 54 
a ask base 08 .08 .13 12 
Re nbeseeks —.47 
Ds SPOS : 17 
RPE 53 45 
hh ERS .16 17 


The individual who retains the most also tends to recall it the 
most readily. With the exception of a single negative value in 
reconstruction, this tendency is independent of the speed of 
learning and does not seem to vary according to the method of 


measurement, the degree of learning or the length of the time 
interval. 











VIII. CONCLUSION 


1. The curve of retention varies with the method of measure- 
ment. 

A) The curve as determined by the “saving method” differs 
both in height and general shape from all the other curves deter- 
mined by methods which directly measure the amount of reten- 
tion. For the comparatively shorter intervals, the relearning 
curve falls more rapidly than does most any curve, but the ten- 
dency is reversed for the longer intervals. This difference in 
the shape of the curves follows as a mathematical necessity from 
the predetermined differences in the units of measurement. 

B) Aside from the relearning curve, the other curves stand in 
the order ot their numerical values as follows: Recognition is 
the first, reconstruction the second, written reproduction the 
third and anticipation the last. Many reasons may be given for 
these particular numerical differences, but above all the order of 
the curves is a function of the number of restricting factors in- 
volved in the conditions of recall. 

C) In spite of the variations in the methods of measurement, 
the curves are, on the whole, more similar to that of Ebbinghaus 
than to those of Ballard. 

D) In numerical value, our retention curve for relearning 
approaches most closely to that of Finkenbinder, but our recog- 
nition curve is vastly different from that of Strong. The simi- 
larity of data depends upon the corresponding similarity of tech- 
nique. | 

2. The curve of retention varies with the degree of the original 
learning. The amount of retention for most intervals increases 
with the degree of learning. 

A) Increase in the degree of learning favors the more diffi- 
cult methods for the longer intervals. 

B) The effect of the increase in the degree of learning upon 


the amount of retention manifests the phenomenon of diminished 
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returns. This phenomenon is the incidental and almost necessary 
consequence of the tendency of negative acceleration obviously 
present in the learning curve for memory. 

C) On the whole, the curves of retention for the different 
degrees of learning still approach more closely to the Ebbinghaus 
type than to that of Ballard. The recognition curves are, how- 
ever, far from being logarithmic. 

3. Beyond a certain limit, the duration of the recall process 
has but little effect upon the amount of recall or the curve of 
retention. 

A) The shape of the retention curve for written reproduction 
is practically determined at the end of the first 2 min. of recall. 
For recognition go sec. of recall is long enough for determining 
the shape of the curve. 

B) With the written reproduction method, the effect of ex- 
tending the time limit for recall upon the amount of reproduction 
is negatively accelerative. 

4. The amount of error in written reproduction increases with 
the time interval, but the error curve thus determined manifests 
no definite relationship to the curve of forgetting which also 
rises with the time interval. Nevertheless, the former has to be 
taken account of as a supplementary curve of retention. 

5. The speed of recall decreases with the time interval, but the 
speed curve, too, bears no similarity or causal relation to the 
curve of forgetting, though it is indicative of the conditions of 
retention. 

6. A) Individual variability increases with the difficulty of 
the act of recall, but decreases with the frequency and the recency 
of practice. 

B) The speed of learning and the amount of retention are 
positively correlated. 

The results of these experiments prove that the difference 
between the Ebbinghaus tradition and the type of curve discov- 
ered by Ballard is not due to differences (1) in the method of — 
measurement or (2) in the degree of the original learning. 

We do not find a higher amount of retention for the 2-day 
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interval than for I day or even immediate recall, as did Ballard. 
Differing from the Ebbinghaus tradition, our curves are not 

all logarithmic. Some of the recognition curves do not even 

manifest the phenomenon of negative acceleration in general. 


The curve of retention varies with the conditions of learning 
and of recall. 
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